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AN OVERVIEW OF THE OREGON STUDIES IN EDUCATIONAL RDD&E 



In the spring of 1970 the Training Branch of the U.S. 
Office of Education, National Center for Educational 
Research and Development, announced a plan to effect 
change In the preparation of educational RDD&E person* 
nd. Two factors led to the announcement. The underlying 
factor was the rather dramatic emergence In the past decade 
of development, diffusion, and evaluation activities as 
vehicles for educational improvement, and the attending 
need for qualified personnel to carry them out. The 
precipitating factor, however, was evidence that in spite of 
an Investment of approximately 30 million dollars by the 
Federal Government to help training programs become 
more responsive to the personnel needs created by these 
new activities, essentially the same number and kind of 
personnel were being prepared in 1970 as in 1965. 

The plan for change reflected a strategy that can best be 
described as “beginning at the beginning.” It incorporated 
three interrelated lines of activity: the creation of a 
conceptual and empirical base on which to build functional 
training programs; the design of more effective and efficient 
approaches to training; and the development of instruc- 
tional materials that reflect desired changes in both content 
and procedure. The propositions on which the plan rested 
were straightforward: (a) little was known abort edu- 

cational development, diffusion and evaluation activities, or 
how they related to educational research; (b) even leu was 
known about the training of personnel to carry out such 
activities; and (c) until both of these conditions were 
remedied the likelihood of designing effective and efficient 
programs to prepare personnel to carry them out was slight. 
The plan as a whole was coordinated so that the various 
activities within it would be developed with sensitivity to 
each other, and so that they would come together in 
completed fashion at approximately the tame point in time. 
(For additional details on the plan for change see Chapter I 
in Volume I of the series reporting the Oregon Studies.) 

The Oregor Studies, carried out by the Teaching 
Research Division of the Oregon State System of Higher 
Education, were to contribute in a beginning way to the 
conceptual and empirical base called for in the plan. At 
such they were to produce five products: a collection of 
detailed “case study” descriptions of projects that illus- 
trated exemplary RDD&E activities within various edu- 
cational contexts; a reliable, economically feasible method- 
ology by which to collect the data needed to prepare the 
case studies; a conceptual system or framework for viewing 
the domain of educational RDD&E that could be used as a 
guide to the classes of data to be attended to in the case 
studies; cross-project analyses that hi^dighted the simi- 



larities and differences observed in the projects described, 
and that tested In rudimentary fashion the adequacy of the 
conceptual framework underlying those observations; and a 
compendium of the existing literature that pertained to 
either the nature of or the interactions between activities 
labeled educational research, development, diffusion and 
evaluation. These products are reported In five volumes: 



Volume I. Summary Report (with Technical 
Appendices) 

Volume II. The Literature of Educational RDD&E 
Part One (Research, Evaluation, and 
Development) 

Part Tv o (Diffusion & Combinations of 
RDD&E) 

Volume III. Conceptual Frameworks for Viewing 
Educational RDD&E 

Volume IV. Profiles of Exemplary Projects In 
Educational RDD&E 
Part One (Research and Evaluation) 

Part Two (Development) 

Part Three (Diffusion) 

Volume V. A Methodology for the Study of 
Educational RDD&E 



Each volume in the series reporting the Studies has been 
designed to stand alone, hut b cause each volume reports a 
different product, and each product can be understood 
fully only in relation to the other products, two “reader’s 
guides” to the scries have been prepared. The first involves 
brief summaries or abstracts of the contents of each of the 
five volumes in the series. These appear on the inside of the 
back cover of the volume, and are intended to serve as a 
guide or overview to the aeries as a whole. A more detailed 
guide is provided by Volume I. In addition to serving as a 
general summary of the Studies, ii contains descriptions of 
the developmental histories of the products reported in the 
various volumes, the relationships that exist between them, 
and the manner in which they have interacted over time. 
Accordingly, for the reader who wishes to determine 
quickly what each of the five volumes in the series contains, 
tu-n to the inside of the back cove: of the volume; for the 
reads who wishes to understand how the volumes relate to 
one another, follow that by reading Volume I. 
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ABSTRACT 



Thin 1b one of five volumes reporting the results of the Oregon 
Studies In educational research, development, diffusion, nd evaluation 
(educational RfiD&E). It. contains 20 case study profiles of educational 
RDD&E projects, and as such constitutes the data base for the Oregon 
Studies. The Volume i« bound in Three parts. Part One contains profiles 
of five research and three evaluation projects; Part Two contains profiles 
of seven development projects; and Part Three contains '.rofiles of five 
diffusion projects. Each part within the volume covalna Miforraatlon 
that describes the development of the profiles ho'.' read the profiles, 
and a glossary of common profile terms. Each profile contains three 
sets of data: (a) descriptors of general project characteristics, c.g., 

objectives, timelines, organizational structures, and project ''dynamics;" 
(b) descriptors of personnel working within projects, Including back- 
ground of training, work experience, and job role definition; and (c) 
descriptors of the work requirements within a project. Work requirement 
data include descriptions of the outputs that derive from a project, the 
standards held for those outputs, the operations required to produce 
outputs to the. standards specified, and the knowledges , skills , and 
sensltlvltleo drawn upon to carry out project operations. Nine hundred 
and sixty-two outputs of work effort were identified in the 20 projects. 
Two hundred and ninety-eight of these were analyzed for their work 
requirements. From this analysis 1148 descriptions of standards, 

3722 descriptions of tasks, and 2974 descriptions of knowledges, skills, 
and sensitivities were obtained. One hundred and thirty-four pro- 
fessional persons were Interviewed in collecting these data. The profiles 
are discussed in the preface to the volume from the point of view of 
their utility as scientific and training documents. 



i’KJJ ACL 



The present volume contains descriptive profiles of JO educnl i un*i 1 
research, development, diffusion, and evaluation (educational KDDM) 
projects. The volume is bound in three parts. Part One contains pro- 
files of 3 research and *i evaluation projects; Part Two contains profiles 
of 7 development projects; and Part Three contains profiles of 3 dif- 
fusion projects. In addition, each part within the volume contains 
Information that describes the development of the profiles, information 
that serves as a guide to reading the profiles, and a glossary of common 
profile terms. In combination, these materials should permit a reader 
to study tiie profiles with sensibility and understanding. 

Each profile attempts to portray the essential characteristics at 
the project it describes and the realities of work requirements wilhJn 
it. Toward these ends, each profile describes: (a) the general rh .rai - 

teristics of a project, c.g., objectives, timelines, organizations 
structures, and project "dynamics ;" (b) the character istics of personnel 
working within a project, including background of training, work expert- 
ence , and Job role definitions; and (O the work requirements within a 
project . 

The central data reported in a profile deals with project work 
requirements. In this regard, each profile describes the o utputs of 
work effort, the standards established for those outputs, the operations 
required to produce outputs to specified standards, and the knowledge s , 
skllls t ahd sensitivities needed to carry out those operations. An over- 
view of the data sets used to describe these variables and their inter- 
dependencies is provided in the reader’s guide to the profiles. The 
rationale for and n full description of the data sets used is provided 
in Chapter 4 of Volume I of the series of volumes reporting the Oregon 
Studies . 

The profiles were designed to serve the purposes ot both science 
and training. In support of science the profiles serve three functions: 
(ji) the careful description of phenomena of interest; (b) the develop- 
ment of a methodology by which to carry out such description; and 
(c) the development of a data base that permits parameter identification 
and comparative analyses. In support of training the profiles serve 
two functions: (a) they provide a means of gaining insight into the 

nature of and work requirements within individual educational RDD&E 
projects; and (b) they provide a means of gaining insight into the 
nature of and work requirements within the domain of educational RDD&E 
as a whole. Because these various concerns have combined to make the 
profiles as they are, each will be discussed briefly. 

PROFILES AS BASIC SCIENCE DESCRIPTIONS. Individually and collec- 
tively the profiles provide accurate, reliable, and relatively exhaus- 
tive descriptions of ongoing RDD&E activities at the project level. 

All projects described are illustrative of the kinds of RDD&E activities 
likely to be funded in the decade ahead. The rationale for obtaining 
such descriptions involved a series of related propositions: Ca) research, 

development, diffusion, and evaluation activities have served as powerful 
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ul nr demands of education; (c) to effectively bring about such adapt .it h*n , 
the demands of Kl)f)&K within education must be understood; (d) at the tin* 
that the Oregon Studies were undertaken 1'ttle was known about educational 
development, diffusion, and evaluation activities, about huv such aitlvi 
ties related to educational research, or about bow any or all activities 
related to the improvement of education; and (e; in order to understand 
natters not understood it is wise to begin hv describing them in detail. 

Jhe rationale for reporting such descriptions In case profile format w.r 
Less complex: It Invited a more detailed description of project charac- 

teristics and activities than might otherwise be provided. Tiis was 
assumed to be true for both the ident i f icat ion of the variables to be 
attended to in describing projects and u.c exploration of the inter- 
act inns of those variables. 

PROFILES AS METHODOLOGICAL PROVING GROUND. The decision to deset i be 
educational RDD&E projects in cas^ profile terms required that a icethod- 
ology be developed that would generate "c ise study” data. The develop- 
ment of suJt h methodology became a primary focus of the Oregon Studies, 
and the preparation of profiles was, to a large extent, a natural culmina- 
tion of that focus. Two assumptions accompanied the emphasis on method- 
ological development: (*0 the Oregon Studies represented the first in 

a scries of empirical studies to be undertaken on the nature of educa- 
tional RDD&E; and (b) greater benefits would accrue to education ovet 
f he long terra by directing limited resources to tne development oi strong 
methodology than would accrue had the investment of resources been di roc Led 
to the collection of large amounts of data with a weaker methodology. 

As «i proving ground for methodology, the profiles provided a basis 
for making two kinds of judgments: (a) judgment as to the s ophistication 

of the methodology, 1 . c • , the extent to which the methodology generates 
accurate, reliable, and reasonably exhaustive descriptions of educational 
KDD&E activities; and 00 judgment as to the robustness of the methouologv , 
i.e. f the extent to which the methodology can be applied to widely 
varying projects with equally productive results. Evidence as to 
sophistication was obtained by submitting completed profiles of projects 
to the directors of those projects for review and approval. In all cases 
the profiles met the criteria of sophistication outlined above (see tho 
Notes on the Development of the Profiles for project director evaluations). 
Evidence as to robustness was obtained by applying the methodology to 
the 20 projects described in the present volume. These projects varied 
widely, and it was assumed that It the methodology was indeed adequate 
In terms of its robustness each of the 20 projects could be described with 
equal facility. It was also assumed that the data generated in relation 
to each project would be roughly comparable. As will be seen upon reading 
the profiles, those criteria have been met. An overview of the method- 
ology is provided in the reader’s Guide to the profiles. A detailed 
description of the methodology, as well as a description of the manner 
in which it evolved, is provided in Volume V of the series of volumes 
reporting the Oregon Studies. 
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PROFILES AS A DATA RASE FOR PARAMETER IDENTIFICATION AND COMPARATIVE 
ANALYSES. The decision to view the profiles as a data base for ident 1 i v 1 ng 
or "mapping" the parameters of the domain of educational KDD&E emerged .is 
a logical extension of the two previously discussed profile function 1 .. 

Since extensive descriptive data on the nature of educational RDD&L were 
to he made available as a result of profile development, and since profiles 
were to be prepared for widely varying projects to test the robustness of 
a methodology, the selection of the projects to be described was approached 
from the point oi view that they represent a sample of the projects that 
exist within the domain of educational RDD&E as a whole. Given the small 
number of projects that couxd be described In case study form with the 
resource base available, and given the variability that was to be reflected 
in those projects, no Illusions were held about the representativeness 
of the sample that could be drawn. At the came time. It was reasoned 
that If the projects to be described sampled at all well the variability 
< hat existed in projects within the domain, the descriptions of those 
projects would provide at leas, a beginning base for sketching an "outline 
map" of the parameters of the domain. As an outgrowth of this kind of 
reasoning, It was decided that projects should vary systematically with 
respect to major sources of variability In educational RDD&E projects as 
a whole. Accordingly, the 20 projects described vary as to focus (research, 
development, diffusion, and evaluation), size (a funding base of less than 
$100,000 per annum, between $100,000 and $250,000 per annum, and over 
$250,000 per annum), and setting (public schoolB and state departments 
of education, colleges and universities, publicly funded laboratories 
and K&D centers, and privately funded K&D Centura). A description of 
the procedures followed and criteria used In selecting the 20 projects 
is provided In Chapter 3 of Volume 1 of the scries of volumes reporting 
the Oregon Studies. 

As a data base for mapping the domain of educational RDD&E, the 
profiles actually serve two functions: (a) they provide a basis tor 

mapping the parameters of the domain; and (b) they provide a basis for 
mapping the commonalities or central tendencies of the domain. As a 
basis for parameter mapping the profiles constitute an excellent source 
of data. Even though the project sample is small, and the absolute data 
base on which to prepare maps limited, projects have been selected so 
as to insure that they arc reasonably representative of the range of 
projects to be found within the domain of educational KDD&E. Thus, the 
range of personnel employed in the 20 projects described, the range of 
project strategies followed, the range of organizational structures used, 
the range of outputs produced, the range of tasks performed, the range of 
standards held, and the range of knowledges, skills, and sensitivities 
drawn upon in their execution can be assumed to be reasonably representa- 
tive of the range of such things to be found within the domain as a whole. 
The technical appendices that accompany Volume I of the series of volumes 
reporting the Studies summarize these data. 

Given the sampling strategy that was followed, it is obvious that 
the profiles constitute a much weaker data base for mapping commonalities 
or central tendencies. Clearly, the sample was drawn to highlight the 
parameters of the domain rather than its central tendencies. Nevertheless, 
the data are amenable to central tendency analyses, and they were under- 
taken. The "outline maps" presented in Chapters 6, 7, and 8 of Volume 1 

v 
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of the r.erl^s nf volume** reporting the Oregon Studies summarize these 
data. 






H'OFILE: AS TRAINING AIDS. As the most detailed descriptions of 
ongoing KbbfcL activities available, it was anticipated that the profiles 
could serve a valuable training function. Readers should find, for 
example, that they illustrate the nature of the work found within 
educational. RJ)D&E projects, the nature of the tasks Involved In carry- 
ing out that work, the knowledges, skills, and sensitivities needed to 
carry it out, the interpersonal and interagency dynamics involved In 
project operation, etc. Such information should he of value to students 
preparing to enter the field of educational RDD&E, staff who have just 
entered the field , or project directors who need to provide on the Job 
training. 



PROFILES AND CROSS PROFILE ANALYSES AS A BASIS FOR TRAINING PROGRAM 
DESIGN. liy treating each of the 20 profiles as reliable descriptions of 
"what life is like" within the context of educational RDD&E projects, 
by treating the summated data as a trustworthy description of the range 
of project activities within the domain as a whole, and by having at 
hand whatever central tendency data that can be gleaned from the compar- 
ative analyses of projects, the designer of training programs should he 
in a position to make reasonably informed decisions as to what the focus 
and content of those programs should be. In combination these da^a begin 
to provide the designers of training programs with a sense of the arena 
within which educational RDD&E personnel must function, and with a sense of what 
has to be done to function effectively within that arena. Chapter 14 of 
Volume I oj the series of volumes reporting the Oregon Studies spells 
out some of the implications that derive from these various data sources 
for the design of training programs. 

A wide range of persons have been involved In the preparation of 
the profiles. In fact, nearly all persons involved in the Oregon Studies 
have contributed in one way or another, for essentially all activities 
undertaken within the studies have pointed towards profile production. 

Since other volumes detail the activities that have been related to 
profile development, e.g., the development of the methodology used to 
collect the data reported in the profiles (Volume V) and the develop- 
ment of the conceptual framework that guided the methodology (Volume 
111), the persons involved most directly in those activities need not 
be recognized here. Those who have been most directly involved in 
profile preparation do, however, and the purpose of the following 
paragraphs is to make that recognition public. 

It is proper to acknowledge first those persons in the U.S. Office 
of Education who had the wisdom and courage to insist upon the develop- 
ment of case profiles, and their accompanying methodology , as the 
primary outputs of the Oregon Studies. In this regard the efforts of 
Ms. Cora Beebe and Drs. John Egermeler, Sue Klein# and Paul Messier 
' 4 oscrve special recognition. So do the efforts of Dr. John Hopkins 
of Indiana University, the U.S. Office of Education’s special consultant 
to the project. The contributions of these five people to the design 
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and lnplemen tatiun of the case profiles and Liie supporting methodology 
have been of inestimable value. Also deserving of recognition is the 
role played in t lie project by USOE project officers. Their willingness 
to review projects to help in identifying those that appeared to meet 
the criteria for Inclusion in Hie Oregon Studies was clearly beyon ' 
their established duties. My thanks to all in 1,‘SOK who have given 
so much. 

1 wish to express my thanks also to the directors of the various 
projects for which case profiles were prepared, and to their staffs. 

It is not easy to give up as much as three days of time when conducting 
a major ROD or E project, or to release major staff members lor as much 
as a day or a day and a half to do other than project work. Participa- 
tion in the Oregon Studies represented a sizeable investment of these 
people's time and energy, and I wish to exprem my deepest appreciation 
for their willingness to make such an investment. 

Kinally, 1 wish to express my thanks to the staff of the Oregon 
Studies who were responsible for data collection, reduction, and profile 
preparation. Since so many have been involved, and in ao many different 
ways, I will almply list names by activity. Thus, the task of refining 
the criteria for project selection, identifying projects that met those 
criteria, and making initial contact with those projects relative to 
participation In the study: the team of Mr. Steve Anderson, Mr. Harrell 

Clukey, Dr. Dale llamreus, and Dr. Jim Nord; the task of making site visits 
for purposes of final project selection: the team of Dr. Harry Ammo r man , 

Dr. Dale Hamreus, and Mr. Greg Thomas; the task of data collection, 
reduction, and initial profile preparation: Mr. Loring Carl. Mr. Norman 

Crowhurst, Mrs. Lee Green, Mr. Herb Hill, Mrs. Diane Jones, Dr. Rod Mvers. 
Dr. Jim Nord, Mr. Dean Plelstlck, Mr. Clark Smith, and Mr. Greg Thomas; 
the task of profile editing and refinement: Dr. Harry Ammorman, Mr. 

Loring Carl, Mr. Darrell Clukey, Dr. Kevin Morse, and Mr. Greg Thomas; 
the task of coordinating and scheduling the interview teams: Mr. Greg 

Thomas; the task of interview team training, and the task of administer- 
ing quality control checks on all data reduction: Mr. Loring Carl and 

Mr. Clark Smith; the task of tracking all data from the time it came in 
from the interview teams until It was organized and presented within 
a completed case profile, Including the task of editing each profile 
to assure consistency and quality: Mr. Darrell Clukey; the task of 
transferring the reduced data to compucer storage, the preparation of 
computer programs for the analysis of the data, and the execution of 
those analyses: Mr. Bill Hlckok; the task of overall activity 

coordination: Dr. Harry Amroerman. 

My deepest thanks to all for tasks well done. 



H. Del Schalock 

Director of the Oregon Studies 
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NOTES ON THE DEVELOPMENT OF THE PROFILES 



Fourteen specifications guided the development of the profiles that 
appear in the present volume. Seven of the 14 pertained to the content 
of the profiles. 

1. They were to accommodate widely varying data within a standard 
format, that is, a single format was to accommodate data 
emerging from an "evolving" case study methodology that was to 
be applied to projects of widely varying characteristics; 

2. They were to convey both the "essential** features of a project 
(as opposed to every possible feature), and the **realit ies" 

of work within it ; 

3. They were to include a description of the context within which 
a project was operating; 

4. They were to include both, but discriminate between, sub- 
jectively and objectively derived data; 

5. They were to include the "raw" data from which categorized 
data emerged; 

6. They were to highlight the training implications that emerged 
from the study of a particular project; and 

7. They were to avoid description of the substantive content of 
a project, except as needed to understand a project within 
the context of the profile. 

Four specifications pertained to the form of the profiles: 

1. They were to preserve the anonymity of persons within projects; 

2. They were to be candidly written, but without evaluative 
overtones and without reference to outside standards for 
comparative purposes; 

3. To the extent possible, each profile was to make a unique 
contribution to the set of profiles (thus allowing indi- 
vidual differences between profiles with respect to degree 
of emphasis on various classes of data, depth of detail, 
etc.); and 

4. They were to be readable and understandable by persons just 
entering the field. 

Three specifications pertained to the means by which the profiles were 
prepared : 
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1. The profile design, and the linkage of that design to data, 

was to be such that persons relatively unskilled in professional 
report writing could, without elaborate training, assemble 
and prepare a profile; 

2. Profiles were to be prepared and made available for review 
and/or use as soon as possible after the analysis of a 
project had been completed; and 

3. Profiles were to be approved before publication by the directors 
of the projects described. 

In sum the task of the Oregon Studies was to develop a procedure and 
a format for writing profiles that would display widely differing kinds 
of data from widely differing projects in a manner that would be easily 
understood, and that would allow for comparability across projects while 
retaining the ability to present characteristics idiosyncratic to indi- 
vidual projects. Furthermore the procedure and format were to ac :omodate 
the variability introduced in data by an ’’evolving" methodology, and were 
to be able to be applied by persons with little or no experience in formal 
report writing. The profiles reported in the volume meet or have met 
these specifications. 

Procedurally , profile design progressed through six identifiable 
stages. The first stage occurred prior to data collection activities, 
and involved the outlining of alternative profile formats for anticipated 
data. These were prepared for conference review in conjunction with the 
first review of the proposed methodology (July 1970). In the second 
stage of development, alternative profile formats were prepared for a 
single project using trial data collected on that project. These were 
prepared for conference review in conjunction with the second review 
of the methodology (October 1970). It was through these two external 
review conferences that most of the specifications relative to the 
development of the profiles emerged. 

The third stage in the evolution of the profiles involved the 
development of a format that accommodated both the specifications that 
had been developed, and the data that were by then emerging from application 
of the methodology. Four profiles were prepared according to this torraat, 
and submitted for conference review in conjunction with the third external 
review of the methodology. This was held in March 1971, and constituted 
the last formal review of the profile format. In all three of the 
external review sessions, participants included the consultants to the 
Oregon Studies, training program directors, U.S. Office of Education 
personnel, and the authors of the conceptual papers that appear in Volume 
III of the series of volumes reporting the Oregon Studies. 

Following the March review, the profile format went through three 
additional "fine tuning" stages in its development. The first of these 
(Stage 4 in the development of the profile formats) incorporated both 
the recommendations received at the March conference and the subtle 
shifts that occurred in data collection strategy following that conference. 
Six profiles were prepared using this particular format. The next to last 
refinement in format (Stage 5) reflected the final refinement in data 
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collection methodology, and was used in describing the remaining 10 
projects analyzed. The final refinement in format (Stage 6) involved an 
internal review of the total set of profiles from the point of view of 
standardizing terminology, table headings, and category labels. 

Because of the evolution of data collection methodology and profile 
format during the course of the Oregon Studies, it was not possible to 
achieve complete standardization acxoss profiles. The first four profiles 
prepared contained data that were sufficiently different from the data 
reported in the next six, and the data reported in those six were suf- 
ficiently different from that reported in the last 10, that differences 
between the three sets could not be eliminated by the final refinement 
effort. As a consequence, the total collection of profiles reflect 
three recognizably different formats, as well as three slightly different 
data sets. All profiles contain the same basic chapter organization, 
however, and the same major headings within chapters, so differences 
between profile sets are minimal. The GUIDE TO READING THE PROFILES 
has been designed both to introduce the reader to the substantive content 
and organization of the profiles, and to place the differences in profile 
format in perspective. Chapter 4 of Volume I of the series of volumes 
reporting the Oregon Studies traces the implications of profile format 
differences for cross-project analyses. 

A number of procedures were adopted as guides to the preparation 
of profiles. Profile writers were always members of the data collection 
team and they always knew in advance when they were to serve as writers* 

To insure consistency across writers, chapter titles, major headings 
within chapters, data tables and figures, and data sources were standard- 
ized. During the actual process of preparing the profiles, writers were 
instructed to make use of all record forms, tape recorded interviews, 
and data presentations. Debriefing sessions conducted with the members 
of the data collection team were held to further the writer’s under- 
standing of both the project as a whole and the data collected in rela- 
tion to it. 

Profile drafts were given substantive critiques by all members of 
the data collection team, and editorial critiques by at least two other 
Oregon Studies staff. Where extensive revisions were needed, the 
revised drafts were subjected a second time to a complete review and 
critique process. Upon completion, each profile was submitted for 
review and approval to the responsible officer of the project being 
described. The last five profiles submitted to project officers were 
accompanied by a profile rating sheet in order to obtain specific infor- 
mation as to their adequacy. The results of these ratings are summarized 
in Table 1. 
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l'rt'f|u»'n*-v of Ratings as to Pml I K; Aflt»r|tiary 

(N - 3) 



focus of rating 


Hat in 

::: :i 


ig !i< lu t 

■::i 


luji 


L. 


Description of organizational structure 


r;Tj 


DfJ 


1 DO 


2. 


Description of organizational operations, 


rn 


DO 


| | 6 | 




interrelationships 








3. 


Description of the ends being sought by 


m 


i 


0 




the project 








A. 


Representativeness of all outputs indexed 


l -U 


L 2 


roj 




(Ch. II) 








5. 


Representativeness of the outputs analyzed 


[7G 


( i 


0 




(Ch. ill) 








6. 


Accuracy of the data presented on outputs 
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Rating Schedule 

Check box A, B, or C as follows: 

A = Representative of a majority of operational concerns. 

B = Representative of only a part of operational concerns 
(concerns of significant proportions omitted). 

C = Major concerns not covered. 
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A GUIDE TO HEADING THE PROFILES 



Since the profiles are relatively complex documents, and since 
they vary in format (see NOTES on the development of the profiles), a 
guide to their reading has been prepared* The guide is designed to 
orient the reader to (a) the classes of data reported in the profiLes, 
(b) the procedures followed in collecting those data, (c) the trust- 
worthiness of those data, and (c[) the manner in which the data have 
been organized within the profiles, If used in conjunction with the 
NOTES on the development of the profiles and the GLOSSARY of profile 
terms that also appear in the volume, a eader should have no dif- 
ficulty in making his way through the profiles. 



Classes of Data Reported in the Profiles 

As indicated in the preface to the volume three major classes of 
data are reported in each profile; (a) descriptors of general project 
characteristics; (bj descriptors of project personnel; and (O descrip- 
tors of project work requirements. Work requirement data are reported 
both in terms of work activities associated with job roles and work 
requirements associated with project outputs. The data sets that 
comprise these various data classes are described briefly in the para- 
graphs that follow. The rationale for and full description of the data 
sets appear in Chapter 4 of Volume I of the series of volumes reporting 
the Oregon Studies, 

Data Sets Used in Describing the 
Gener a l Characteristics of Projects 

Five data sets are used to describe the characteristics of a 
project as a whole; (ji) the objectives of, rationale for, and contribu- 
tions to be made by a project; (b) the timelines established for complet- 
ing work within a project; (c) the organizational strucLtre within which 
the work of a project is carried out; (d) the political-institutional- 
intellectual context within which a project rests; and (e) the "dynamics" 
of project operation. The first three data sets are self-explanatory, 
Context data pertain to the relationship of the project being studied 
to its sister projects, to the activities of the administrative unit 
within which it rests, and to the broader political- institutional context 
within which it rests. These relationships are portrayed in the form 
of a "context map." 

As used in the Oregon Studies, "project dynamics" is a catch-all 
term that involves information pertaining to procedures, feelings, 
patterns of behavior, or anything else that can be used to convey a 
sense of either the "essence" of or the "reality" of working within a 
particular project. The focus of that which is reported may be project 
operations, factors influencing project operations, and/or the 
consequences of project operations. Operationally, the data pertaining 
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to project dynamics involves the pooled perceptions, observations, 
ImnHies, and Insights pained by the staff of the Oregon Studies during 
the I li r i*c' to five day on-r;ite visit required ler project analysis. 

no ! urinal category sots have been developed for coding any oi these 
data. All are reported in the form of narrative statements within the 
context of the case profiles. 



Data Se ts Used in Describ - 
ing Project Personnel 

Three data sets are employed in describing project personnel: (a) 

the background of training and work experience of professional staff; 

Cb) a description of the job or jobs held by professional staff; and 
(O the support services and resources available to staff in the perform- 
ance of their respective job roles. All of the data within these 3ets 
are reported in terms of questionnaire items. 



D ata Se ts Used in D e scribing Work 
Activi t ic s Associ ated With Job Role s 

Two data sets are employed in describing work requirements associated 
with job role: (a) the perceived requirements associated with a particular 

job held; and (b) the emphasis given to various classes of work activities 
within the context of a particular job held. These data are also reported 
in terras of questionnaire items. 



Data Sets Us ed in Describing Wo rk Requirements 
Associated With th e Producti on of Project Outputs 

Four data sets are employed in describing work requirements associated 
with the production of project outputs: (a) the outputs of work effort 

per se; (b) the standards held for those outputs; (£) the operations 
required to produce specified outputs to specified standards; and (cO 
the knowledges, skills, and sensitivities required to carry out those 
operations. These are the primary data sets reported in the profiles, 
and as such they are far more complex and extensive than the other 
data sets reported. 

In attempting to describe the outputs of projects, and the standards, 
operations, and enablers that relate to them, it was necessary to establish 
a number of category sets to handle the complexity that was found. Two 
approaches were taken to the development of these sets: (a_) a conceptual- 

empirical (deductive) approach; and (b) an empirical-conceptual (inductive) 
approach. In the former, category sets were developed as an extension 
of the conceptual framework that guided the Studies;^ in the latter, they 



1 For a description of the conceptual framework that guided the empirical 
thrust of the Oregon Studies see Schalock, H.D. and Sell, G.R., "A Frame- 
work for the Analysis and Empirical Investigation of Educational RDD&E," in 
Chapter 4 of Volume III of the series of volumes reporting the Oregon Studies 



wore developed in response to the data emerging irora the study of ongoing 
projects. ^ Operationally, however, the two approaches were complementary , 
for the conceptual-empirical approach yielded category sets that functioned 
as relatively broad, general organizers of the data, and the empirical- 
conceptual approach yielded category sets that functioned at a "close to 
the source," descriptive level. Figure 1 provides a summary of the concep- 
tually derived sets used to organize information about project outputs, 
standards, operations, and enablers. Figure 2 provides a summary of the 
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STRUCTURE 
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LEVEL 
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Management 

Production 
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Technology 
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Component Tasks* 

Facilitating Actions 



FIG. 1. Category sets used to describe at a broad, conceptual 
level the properties of outputs, standards, operations, and enablers. 

*0f this set, only task level descriptions were obtained. Time 
and resources did not permit an analysis of operations at the 
level of actions, and the activities set was left to be derived 
empirically. 



empirically derived category sets used to organize the same information, 
that is, statements describing work requirements in the language of persons 
working in the field. The various primary and cluster categories that 
make up these sets, as well as the procedures followed in their develop- 
ment, are described in Chapter 4 of Vol. I of the series reporting the 
Oregon Studies. The number of data statements (interviewee statements) 
classified within these various category sets include 1148 that are 



^To some extent this is an over simplification, for the conceptually 
derived categories were tested empirically in the course of their 
derivation, and the empirically derived categories were always influenced 
by conceptual considerations. (See Chapter 2 in Volume I of the series 
of volumes reporting the Oregon Studies, or Volume V, for a discussion 
of the procedures followed in the development of the methodology.) 



descriptive ot output standards, 3722 that are descriptive of output 
related tasks, and 2497 that are descriptive of output related enablers. 
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viewee Statements 



79 280 136 



Number of CLUSTER 
Categories Used to 

Classify Primary 5 ^ 45 

Categories 



FIG. 2. Category sets used to describe at a "close to the 
source," empirically derived level the properties of outputs, 
standards, tasks, and enablers. 



The Interdependence of Data Sets 



As indicated in the preface, each case profile was to describe not 
only the variables listed in the preceding paragraphs, but their inter- 
dependencies as well. This in turn required that a way be found to 
collect data on those interdependencies. Accordingly, a schema was de- 
veloped which placed the full set of variables within the context of an 
interacting whole. Within this context OUTPUTS were adopted as central, 
that is, all other data sets were linked to them. Procedurally , this 
required that outputs of work effort within a project be identified, a 
set of these be selected for analysis, and for each output analyzed 
establishing the STANDARDS set for its production, the OPERATIONS re- 
quired for its production, the ENABLING KNOWLEDGES, SKILLS, and SENSI- 
TIVITIES needed for its production, the PERSONS involved in its 
production, and the RELATIONSHIP of that output to the other outputs 
involved in the work of a project as a whole. It was also possible to 
link a particular output to the organizational structure of a project, 
the context within which the project rested, and even the "dynamics" 
of a project, though not so directly as in the case of variables that 
depended upon output linkage for their definition. The interaction of 
these various classes of data is illustrated schematically in Figure 3. 
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FIG. 3. Classes of information sought in describing a project, 
and their relationship to outputs of work effort. 
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Tli r cm* relatively distinct procedures were employed Ln collecting 
the data reported in tin* profiles, by and large these corresponded 
with the three major classes of data collected* All data, however, 
were collected within tne content of an "on-site" visit by a data 
collection team from the Oregon Studies. Depending upon the* size and 
complexity of a project, teams consisted of from two to six people, 
and the length of the site visit extended from three to five days. 

An overview of the procedures used in collecting the various classes 
of data reported in the profiles is provided in the paragraphs that 
follow. Additional detail is provided in Chapter 4 of Volume 1, and in 
Volume V, of the series of volumes reporting the Oregon Studies. 

General Project Descriptors 

Probably the best label for the procedures used in collecting 
data on general project descriptors is that of "non-obt rusive . V The 
objectives of a project, the rationale for a project, project time 
lines, organizational structures, and the like, were obtained from 
project proposals and other documents descriptive of the project. 

Also, information on the "dynamics" of the projects were gathered 
through incidental observation, the recall of casual comments made 
by project staff while being interviewed, and the "hunches" or 
"insights" gained while working with project data. Almost without 
exception these sets of data were able to be collected without in- 
trusion upon people's time and energy. 

The one data set used to describe the general characteristics 
of projects that was intrusive was the data set that described the con- 
text within which the project rested. Some information of this kind 
was usually able to be gained from proposals and other documents, but 
in all cases project directors were interviewed when developing a 
context map. In some instances this amounted to little more than 
confirmation of information gained elsewhere, but in others it in- 
volved both the generation and piecing together of information about 
intra- and inter-institutional linkages that were simply not made 
explicit in existing materials. Generally speaking, the larger the 
project the more complex its political-institutional-intellectual 
linkages, and in some cases, for example the Children's Television 
Workshop, the development of a map to depict these linkages was a 
major undertaking. 

Personnel and Work Activity Descriptors 

All of the data that describe the personnel associated with a 
project, and all of the data that describe work activities associated 
with job roles, were collected through questionnaires. These were 
administered by members of the Oregon Studies staff, either while 
visiting the project site or through telephone. Three questionnaires 
were involved: (ji) a general project questionnaire; (b) a job/task 

inventory; and (c) a general activities questionnaire. The data 
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reported from the three questionnaires are referred to in the profiles 
as form 02, 03, and 04 data respectively. Copies of the three question- 
naires may be found in Volume V of the series of volumes reporting the 
Oregon Studies. 

Output and Work Requirement Descriptors 

All data on outputs and work related to their production were col- 
lected through interview. The interview strategy called for: (a^) 

identifying outputs associated with a project (an output index); (b) 
ordering those outputs according to their interdependencies (an output 
map); (c) selecting from the map those outputs for which work require- 
ment data were to be obtained; (d) identifying persons most directly 
responsible for and/or most directly involved in the production of those 
outputs; and (je) interviewing those persons in relation to the standards 
held for the output being analyzed, the tasks required to produce the 
output, and the knowledges, skills, and sensitivities needed to perform 
the required tasks. The selection of outputs to be analyzed was done by 
the data collection team, on site, after an output map had been estab- 
lished and a sense had been gained as to the outputs that were most 
critical to the project. Persons interviewed provided information 
relative to his or her own contribution to the production of a particular 
output, as well as the contributions of others (a distinction between 
self-other data was maintained throughout the project.) As familiarity 
with a project grew, adjustments were made as needed in the output map, 
the selection of outputs to be interviewed around, and the matching 
of interviewees with outputs. All interviews were tape recorded, and 
all data were reduced from the recordings by the person who did the 
interviewing. 

The reduction of the interview data involved a multistep process: 

Ca) editing tapes to identify data statements within them, that is, 
statements pertaining to standards, tasks, and enablers; ( b ) the recapi- 
tulation, or "recapping”, of data statements into a readable, gram- 
matically correct form, that is, independent clauses and/or sentences 
(care was taken not to destroy the original language of the interviewees 
in this process); (c_) the transfer of the recapped statements to color- 
coded summary sheets that corresponded to the various data sets being 
used; (d) the coding of the recapped statements by a two person coding 
resolution team (during this process the coding team was free to call 
upon members of the data collection team for statement clarification, 
interpretation, context building, etc.); and (e ) the storage of the 
coded data in computer files in a way that permitted the interdependencies 
within the data to be maintained. A record of all steps la the data 
collection and reduction process was maintained from the time of first 
contact with a project until all data on that project had been computer 
stored and verified. 
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Mni <• tin- i l.tHMi-s of data reported Ji tin- proMIcs were collected 
liy various means, each must be considered separately as to Its trust - 
worthiness. Accordingly, tile potential sources ol error that reside 
within each data class, and the steps taken to eont rol them, are reviewed 
In the paragraphs that toliow. 

General Project Descriptors 

Four of the five data sets used to describe the general character- 
istics of projects made use of working documents. These included project 
objectives, timelines, organizational structures, and context maps. 
Typically, the document used had been prepared by project directors. 

To the extent that such documents can be accepted at face value, and 
to the extent that the Oregon Studies staff did not introduce error in 
reporting the substance of those documents, the data sets that made use 
of them were subject to few sources of error. As a consequence, no 
formal measures of trustworthiness were prepared for them. 

Judgments relative to the trustworthiness of the data reported on 
project dynamics is another matter. It will be recalled that these data 
consist of the pooled observations, hunches, "insights," and choice tid- 
bits of information gleaned by members of the data collection team from 
a wide variety of sources. It will also be recalled that these data 
intentionally were to be subjective and impressionistic. As a means of re- 
ducing gross error all final descriptions of the dynamics of projects 
were read and confirmed by all members of the data collection team that 
visited a project, but no formal measures as to the trustworthiness of 
such data were obtained. For purposes of profile presentation, however, 
the data on project dynamics are reported. 

Per s <1 n nel and Work Activity Descriptors 

Since the data sets describing personnel and work activities were 
derived through questionnaire methodclogy they were subject to all the 
sources of error known to operate within that methodology, for example 
the error that is introduced through the selection of questions asked, 
the possibility of multiple interpretations of those questions, and the 
lack of opportunity to determine falsification or shoddiness of response 
to the questions. The steps taken to control these sources of error were 
of two kinds: (a ) reasonable care in the development and testing of the 

questionnaires prior to their utilization for purposes of data collection; 
and (Jb) the administration of the questionnaires while the data collection 
team was on site. The first step involved a number of field trials of 
the questionnaires, and a number of revisions in them on the basis of 
those trials. The second allowed the questionnaires to be introduced 
within the context of the data collection effort as a whole, and within 
that context an opportunity to clarify troublesome questions about or 
within them. In combination, it is believed that these procedures 
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sufficiently reduced the typical sources of error that enter tlu* collec- 
tion of questionnaire data that the data reported can he viewed with a 
fair degree of confidence. 

O utput and Work Requirement Descriptors 

Just as the personnel and work activity data were subject to the 
error typically associated with use of questionnaires, the output and 
work requirement data, since it was collected through interviews, were 
subject to the error typically associated with interviews. Four sources 
of error hove always been troublesome in this regard: (a) the selection 

of interviewees as data sources; (b) the information elicited from inter- 
viewees about work requirements; (£) the coding of the information 
obtained from interviewees; and (d) the storage, retrieval, and analysis 
procedures used in manipulating the coded data. 3 The procedures followed 
in the Oregon Studies to combat these sources of error are summarized in 
Table 1. Given the procedures followed, and the coding reliability 
obtained, it seems r> .’sonable to view the output and work requirement 
data with a good deal of confidence. 



Profile Organization 



It will be recalled from reading the NOTES on the development of 
the profiles that three variations in profile format will be found in 
the present volume. These correspond to variations in the nature of the 
data collected at various points in the Studies, and represent one of 
the less fortunate consequences of the decision to emphasize methodo- 
logical development (see Preface). Although the differences in the data 
presented in the three profile formats are not great they can be con- 
fusing to a reader when first encountered. The purpose of this section 
of the GUIDE is to introduce the reader to the general organization of 
the profiles, and to spell out how the two earlier profile formats (Formats 
1 and 2) differ from the final format (Format 3). 



3 When the profiles are being considered as a data base for cross-project 
analyses, other sources of error must be considered. Two critical 
sources are (a) the adequacy of the sample of projects drawn and (bj the 
adequacy of the sample of outputs selected for analysis within a given 
project. These are sources of error that relate to the generalizability 
of data, however, and arc not of primary concern in considering the case 
profiles as descriptions of individual projects. 
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SOURCE OF ERROR 



PROCEDURES FOLLOWED TO REDUCE ERROR 



Interviewee Only staff intimately acquainted with or involved in 

Selection the production of an output were selected for inter- 

view. The relationship of the interviewee to an 
output was always confirmed by th? project director, the person to be 
interviewed, and the immediate supervisor of that person. Data re- 
ported by an interviewee on the work of others in relation to an out- 
put were noted and coded separately. 

Data Generation A structured interview procedure was used to obtain 

data on the standards, tasks, and enablers associated 
with a particular output. In the interview, standards were the first 
to be identified, followed by the tasks engaged in to produce the out- 
put to those standards, followed by the knowledges, skills, and sensi- 
tivities drawn upon in carrying out the tasks identified. Stylistic 
variations in interviewing were permitted so as zo accommodate either 
interviewer or interviewee differences, but during the course of an 
interview all data sets were exhausted. (For a detailed discussion 
of interview procedures see Volume V of the series of volumes report- 
ing the Oregon Studies). 

Data Reduction A carefully established set of procedures and 

decision rules were followed in "recapping" the 
interviewee statements, and in coding the recapped statements in 
terms of appropriate data sets. The recapped statements were first 
checked for their completeness and adequacy by the data coordinator 
upou the return of the data collection team fi m a project site. 

They were checked again by the coding team. Incompleteness, or 
error, or lack of clarity detected on either of these checks required 
that the recapped statements be revised until they were acceptable 
at both quality assurance checkpoints. To insure reliable coding, 
team coder agreements were calculated. Using the recapped statements 
in three case profiles as a base for calculating coder reliability, 
and separating fii*st and second codings by a three month period, 
coding agreements for items in each data set, with one exception, 
ranged between .69 and .96. Reliability in coding task statements 
was .60. Detailed coder reliability data are reported in Chapter 4 
of Volume I of the series of volumes reporting the Oregon Studies. 

Data Storage As soon as the recapped statements hrd been coded 

and Retrieval for a particular project the codes were forwarded 

to the data coordinator for a check of their com- 
pleteness, and then forwarded to the coordinator of data storage and 
retrieval for transfer into computer storage. After storage, repeated 
checks were run to insure that the initial computer entries were 
correct, and the computer center manipulations over time had not 
destroyed or reordered the data as it was originally stored. 
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Profile Format 3 



Tqn profiles in the volume meet the most advanced format require- 
ments. 4 These are profiles 1, 2, 6 and 7 In Part One of the volume; 
profiles 9, 10, and 11 in Part Two; and profiles 16, 17, and 18 in Part 
Three. As a set these profiles reflect the most advanced form of the 
data collection methodology, were the last to be prepared, and appear 
as the first profiles to be read in any of the three parts to the 
volume, as well as the first to be read in the Evaluation section of 
Part One. Also, all are organized into six chapters: an Overview; 

a Description of the Parameters of the Project; a Summary of Data; 
Supplementary Data; Project Dynamics; and Implications for Training. 

Each profile also contains an Appendix that houses the "recapped" data 
statements from which the output-work requirement data summaries have been 
prepared . 

An overview of the contents of each chapter in the format 3 profiles 
follows. It will be seen from these overview statements that the three 
classes of data collected on a project are collapsed and/or integrated 
for purposes of their presentation within profiles. 

CHAPTER I: OVERVIEW. This chapter provides the first view of a 

project as more than a title. Tt piovides an orientation to the nature 
of the project, its goals, and its reasons for being, and serves as the 
framework into which the balance of the profile data are fit. Structurally, 
the overview chapter consists of the following parts : 

(a) Synopsis of the Project 

(b) Objectives, Rationale, and Significance of the Project 

(c) Context in Which the Project Operates 

Chapter I is generally not more than 6 pages in length, and it is 
designed as an "abstract" so that readers may determine whether they 
wish to read the profile as a whole. 

CHAPTER II: PARAMETERS OF THE PROJECT. Chapter II emphasizes, 

and makes quickly available, a first set of , Tiard n data about a project. 
Standard sections include: 

(a) Staff structure; 

(b) Project roster; 

(c) Index of outputs; 

(d) Output map. 

Staff structure data involves a description of the organizational structure 
adopted by a project, and how staff members are distributed within that 
structure; project roster data involves a description of the roles 
played and/or functions performed by personnel within the project; an 
output index is an annotated listing of the outcomes of work effort 
that project staff identify as critical to the success of the project; 



4 Each profile is identified as to its format number on the back of 
the profile title p-ge. 
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and an output map is a schematic portrayal of the interdependencies 
between project outputs. More is said about output maps later in the 
GUIDE. 

CHAPTER III: SUMMARY OF DATA. In terms of the data sets described 

previously, this chapter would be more accurately titled "Summary of 
Work Requirements for Output Production." Three data sets are summarized 
in the Chapter: (a) the standards held for the production of an output; 

(b) the tasks engaged in to produce an output to the standards set for 
it; and (c) the knowledges, skills, and sensitivities required to perform 
those tasks. Each of these data sets is displayed in standard tables 
as frequencies of category citations. The narrative text of the chapter 
deals principally with the data displayed in the tables, and the inter- 
relationships of those data. 



CHAPTER IV: SUPPLEMENTARY DATA. The chapter on supplementary data 

varies to some extent as to the specific data it contains. In general, 
however, the following data sets are reported: 



(a) 


Kinds of outputs generated at varying stages of project 
completion , 


(b) 


The distribution of outputs by their alternative classifi- 
cations, i.e., structure, function, character and level; 


(c) 


Summaries of staff backgrounds; 


(d) 


Individual job descriptions; 


(e) 


Interviewee responses to questionnaire items relating to 
position requirements, support resources, and project 
management ; 


(f) 


Interviewee responses to questionnaire items citing 
emphases given to various classes of work activities; 




The funding base of the project. 


Tables of the 
the discussion 


data are provided when they serve to provide a focus to 
. Meaningful relationships with data reported in other 



chapters are also pointed out. 

CHAPTER V: PROJECT DYNAMICS. This chapter, by design, is the least 

structured of the profile chapters. The purpose of the chapter is to 
round out the profile by reporting "impressionistic" observations about 
the project. The "data base" for the Chapter was the hunches, observa- 
tions, insights, etc., gained by the data collection team during their 
three to five day stay at the site of the project. These impressions 
are reported in whatever sequence, form, and substance the profile writer 
considered best in calling out the significant and unique features of 
project operation. The freedom of the dynamics chapter to vary in focus 
and content was considered essential to extending the meaning of the 
data collected. It was also seen as essential to methodological develop- 
ment, for it served as the vehicle by which new data thrusts were identi- 
fied for inclusion in the methodology. 
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The substantive focus of the comments included in most project 
dynamics chapters includes some subset of observations with respect to 
staffing patterns, project management structures and procedures, manage- 
ment "styles,” project related commitments, substantive issues that 
arise within projects, affective issues, and agency interrelationships. 

The discussion of such observations is linked, when appropriate, to 
"hard" data. The tenor of the discussion is intended to be non-judgmenta \ 
and instructive. 

CHAPTER VI: IMPLICATIONS FOR TRAINING. In this chapter the know- 

ledge gained about a project is assessed with respect to its implications 
for training. In this assessment the data reported in the profiles 
generally are treated very briefly, for it is assumed that the reader 
can draw his own conclusions from his reading. Instead, attention 
is directed to comments or recommendations made about training by project 
personnel, or which are implied by the nature of the data collected. The 
discussion frequently focuses on training needs mentioned by project staff 
in relation to problems or difficulties in the project. To this extent* 
the discussion tends to highlight areas of competence in which prepara- 
tion was weak. 

PROFILE APFENDIX. The last chapter in each profile is followed by 
an appendix that contains the "raw" data that is the basis for the coded 
data reported in Chapter III. The raw data consists of the paraphrased 
or "recapped" statements of interviewees that describe the standards, 
tasks, and enablers associated with the generation of outputs. Category 
code numbers are included with each statement to facilitate their loca- 
tion in the various tables presented in Chapter III. The importance of 
this appendix extends beyond its function as an aid to the reader, for 
it represents what is presumed to be one of the most meaningful forms in 
which the data collected in the Oregon Studies can be presented for 
purposes of training. Furthermore, the profile appendix is the only place 
where the raw data on standards, tasks, and enablers appear. 



Profile Format 2 



Six profiles in the volume were prepared according to the format 
that preceeded in time the format just described. These are profiles 3, 
4,and 8 in Part One of the volume; 12 and 13 in Part Two; and 19 in 
Part Three. 

The main differences between formats 2 and 3 lie in the language 
used to describe project outputs. In format 2 the language of output 
structure, function, character, and level was not in use, and the distinc- 
tion between products, events, and conditions had not as yet emerged. In 
their place was a language of production and management "products," 
where products served as a loosely defined term to cover what subsequently 
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wno recognized as products* events, and conditions. 

These differences are reflected in the content of Chapters LI and 
ill of the format 2 profiles. In all other respects both the content 
and organization of format 2 profiles are consistent with those repor_ed 
in format 3. 

Profile Format 1 



Four profiles reported in the volume were prepared according to the 
first profile format developed. These are profiles 5 in Part One of the 
volume; 14 and 15 in Part Two; and 20 in Part Three. Since the varia- 
tion between formats 1 and 3 is considerable, differences will be traced 
chapter by chapter. 

CHAPTER I. Same as in format 3. 

CHAPTER II. In place of an output index and an output map there is 
(a_) an index of production responsibilities, (b) a production :sponsi- 
bility tree, (c) an index of management responsibilities, and (<i) a 
management network. These correspond to the output index and output map 
of format 3, and for purposes of data analysis were so treated* i.e., 
they were recoded using the data sets reported in format 3 profiles. In 
format 1, production responsibilities are treated much as products are 
treated in format 3, and management responsibilities are treated much 
as events and conditions are treated in format 3. The distinction 
management and production responsibilities, however, are carried into 
Chapters III and IV of format 1, causing two chapters in the profile to 
be devoted to work requirement data (such data are consolidated in 
Chapter III in format 3). As is the case in format 2 profiles, the 
language of output index and map, and the language of output structure, 
function, character, and level does not exist. 

CHAPTER III. Entitled DETAILS ON EACH PRODUCTION RESPONSIBILITY, 
this chapter presents the data on standards, tasks, and enablers only 
for products pertinent to the contractual obligations of the project. 

The chapter also contains the recapped interviewee statements (in format 
3 profiles they appear as an Appendix), as well as the category frequency 
data that are based upon these statements. 

CHAPTER IV. Entitled DETAILS ON EACH MANAGEMENT RESPONSIBILITY, 
the chapter simply repeats the format of Chapter III. 

CHAPTER V. Equivalent to Chapter IV in format 3. 

CHAPTER VI. Equivalent to Chapter V in format 3. 



Subsequent to the preparation of format 2 profiles, production and 
management "products" were reclassified into products, events, and 
conditions. Two purposes were served by this reclassification: (a) 

it eased the strain of what had come to be recognized as a forced 
classification; and (b) it enabled the data reported in these profiles 
to be used in cross-project analyses. The recoded data are reported 
in supplementary tables that accompany each format 2 profile. 
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CHAPTER VII. Equivalent to Chapter VI in format 3.^ 



Notes on Reading Output Maps 



The output map founrt in each of the profiles contains a wealth of 
information about the outputs of the project under investigation. In 
order to extract all the information that a map contains it is essential 
that the rules guiding the construction of a map be understood. 



The Purpose of the Map 

The purpose of the output map is to present as simply and as 
clearly as possible the interrelationships that exist between the various 
outputs of a project. The desired effect of reading an output map is 
a "picture" of the project being discussed in terms of the dependency 
relationships among the outputs the project seeks to achieve. 



The Elements in a Map 

Figure 4 contains an illustrative output map. A number of elements 
can be identified within it: solid line boxes; labels; code symbols; 

horizontal lines; vertical lines; brackets; dotted lines; dotted line 
boxes; and vertical (long and short dash) lines. Each of these elements 
contributes to the total information contained in a map. The following 
paragraphs identify the information presented by each element. 

Solid line boxes 



l | Each solid line box represents a specific output 

that the project is seeking to achieve. If the 
box stands alone (is not connected to any other 
box by a line) one of two conditions exists: 

(a) the output is considered to have value, but is 
not related to any other output, or (b^) the output 
index did not contain output identifications that 
allowed other outputs to be linked to it. 

Labels 



Within each box there is a label which is the 
descriptor of the output represented. The labels 
found in the box are the same ones used to describe 
a particular output throughout the profile. 



Final 

Report 



Profile 14 was a transition profile, and is peculiar in that it 
incorporates the language of the profile 1 format but the organization 
of profile 2 and 3 formats. 



FIG. 4. Aa lllu* tratlva output up (orarall project mo a gemot 
and technology development). 
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FIG. 4. Continued (Information product* dnvnli 
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evaluation Reporta: 
ALERT (Products) 

P-19 



Coded symbol 



P-01 Final Each box contains, along with the label, a coded 

Report symbol. Each symbol is composeu of a letter which 



identifies the structure of the output (P-product, 
E-event, C-condition) , and a 2-digit numeral which 
identifies the output sequentially with respect to 
the other outputs in the same profile. Code 
numbers are the same throughout the profile. 



Horizontal lines between boxes indicate that the 
outputs so connected have side-effect relationships, 
that is, the production of one influences the other, 
and vice versa. 



Vertical lines between boxes indicate that the upper 
output is dependent on the lower. Until the lower 
output is completed the upper one cannot be completed. 
In the total map, boxes connected by vertical lines 
are hierarchically arranged, those at the top of the 
map being dependent upon all those below. 



Boxes enclosed by brackets represent outputs which 



represented by the box linked horizontally to the 
bracket(s) . 



Dotted lines connecting two brackets are used to 
indicate outputs that are influenced by another 
output when the outputs encompassed by a bracket 
area are large in number, or when influence is 
carried across more than one page of the map. 



are either generated outside the project, but 
influence it, or are outputs generated by the 
project as a function of other outputs but have 
not been indexed by project staff. 



When more than one page is needed to display an 
output map, vertical lines (long and short dash) are 
used on the right of the first page and the left of 



Horizontal lines 



Vertical lines 



Brackets 



o 




are influenced by, but not dependent on the output 



Dotted lines 




Dotted line boxes 



Dotted line boxes represent those outputs which 



Vertical (long and short dash) lines 



i the second page to indicate the point at which the 

| two pages coincide. 
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I / I " ,, ‘ r ' 1 ' • «m.«t out |iul h in,! y appear more than 

" « *»;>!>. This results when they ar, to other outputs 

I <J i Herein ways , ).<*., dependent on one set but Ini luunccd by another 

mint C r Impossible to display both tlie relationships by one place- 
ment, outputs are repeated. 1 

Once the purpose of an output map is understood and the various 

l f JV" defined ' ^ read6r Sh ° Uld be able extract 

great deal, of information from a careful analysis of a map 1 l 

should be made clear, however, that an output map does not attempt 

to display time relationships as do other process chartFluch as PERT 

o,.tn°u r iT fo ^ uses ° n the dependency relationships existing between 
outputs, independent of the factor of time. 
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GLOSSARY OF COMMON PROFILE TERMS 



This glossary contains definitions of terms used frequently in the pro- 
files. Asterisks identify terms that were used in the early forms cf 
the profiles. These terms, no longer in use, are identified with a 
single asterisk to indicate their appearance in profile format 1 and a 
double asterisk to indicate their appearance in profile format 2. When 
terms are used in a definition that are themselves de c ined in the glossary, 
they appear in capital letters. 



ADOPTION. A circumstance in which KNOWLEDGE, INFORMATION, and/or 
TECHNOLOGY is utilized. 

CHARACTER OF OUTPUT. See Output Character . 

COMPONENT OUTPUT. An outcome of work effort that constitutes an element 
of, or an approximation to, a FOCAL OUTPUT. 

CONDITION. An outcome of work effort that creates a desired circumstance 
expected to endure over the life of a project, or as a result 
of it . 

CONTEXT. See Project Context . 

DEVELOPMENT. A problem-solving strategy designed to produce reliable 
technology, that is, procedures, materials, hardware, and 
organizational frameworks that have a known degree of success 
in bringing about a particular outcome or in performing a 
defined operation; also used to designate the focus of 
projects (see Project Focus ) and the focus of outputs (see 
Output Focus ) . 

DIFFUSION. A problem-solving strategy designed to bring about the 

implementation of generalizable knowledge, a reliable tech- 
nology, or trustworthy information (as used here diffusion 
incorporates both the concepts of DISSEMINATION and ADOPTION); 
also used to designate the focus of projects (see Project Focus ) 
and the focus of outputs (see Output Focus ). 

DISSEMINATION. A circumstance in which KNOWLEDGE, INFORMATION, and/or 
TECHNOLOGY ia distributed to a targeted population. 

EDUCATIONAL RDD&E. A coordinated set of problem-solving strategies 
designed to produce outputs that can be judged as to their 
quality and their contribution to the solution of educational 
problems . 

ENABLER. KNOWLEDGES, SKILLS, and SENSITIVITIES needed to produce a 
particular output . 
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EVALUATION. A problem-solving strategy designed to produce trustworthy 
information regarding a phenomenon which occurs in a context 
or environment over which the user expects to exercise 
influence or about which he expects to make decisions; also 
used to designate the focus of projects (sec Project Focus ) 
and the focus of outputs (see Output Focus ). 

EVENT. An outcome of work effort that results in the occurrence of an 
observable transaction or set of behaviors. 

FACILITATING OUTPUT. An outcome of work effort that supports the 
generation of FOCAL or COMPONENT OUTPUTS, but is not in 
itself a part of such outputs. 

FOCAL OUTPUT. An outcome of work effort expected by contractual 
obligation to emerge from a project. 

FOCUS. See Project Focus and Output Focus . 

FUNCTION. See Output Function . 

IMPLEMENTATION. A classification given an output of DIFFUSION, i.e., 
an instance of the ADOPTION and UTILIZATION of KNOWLEDGE, 
INFORMATION, and/or TECHNOLOGY; the objective of DIFFUSION. 

INFORMATION. A classification given an output of EVALUATION, i.e., an 
instance of reliable Information about a given phenomenon 
within a context over which a user expects to exercise 
influence or about which he expects to make decisions; the 
objective of EVALUATION. 

KNOWLEDGE (AS ENABLER). A classification given an ENABLER that 

identifies it as a fact, principle, or generalization, and that 
can stand the test of empirical verification; also, any 
circumstance that can be shown to exist. 

KNOWLEDGE (AS OUTPUT). A classification given an output of RESEARCH, 
i.e., an instance of established fact, principle, etc. that 
is generalizable and that can stand the test of empirical 
verification; the objective of RESEARCH. 

LEVEL OF OUTPUT. See Output Level . 

MANAGEMENT FUNCTION. A classification given an output that orchestrates 
the resources (time, personnel, materials, space, information) 
available to a project for the realization of the outcomes 
expected from it; also a report of that orchestration. 
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MANAGEMENT NETWORK (also MANAGEMENT RESPONSIBILITIES NETWORK).* A 

hierarchical ordering that graphically illustrates the functiona 
relationships between MANAGEMENT PRODUCTS and RESPONSIBILITIES 
within a project. (Subsequently incorporated within output 
maps . ) 

MANAGEMENT PRODUCT.** A classification given a product serving a 

MANAGEMENT RESPONSIBILITY. (Subsequently identified as a 
product serving a MANAGEMENT FUNCTION . ) 

MANAGEMENT RESPONSIBILITY.* Coe Environmental Management Responsibility 
and Production Management Responsibility . 

MANAGEMENT RESPONSIBILITY INDEX.* A listing of the MANAGEMENT RESPONSI- 
BILITIES within a project. (Subsequently incorporated within 
the OUTPUT INDEX.) 

OUTPUT. An identifiable outcome of targeted work activity that con- 
tributes to the realization of project goals. 

OUTPUT CHARACTER. The attributes of an output that mark it as an instance 
of KNOWLEDGE, TECHNOLOGY, IMPLEMENTATION, or INFORMATION. 

OUTPUT FOCUS. The attributes of a FOCAL OUTPUT that mark it as an output 
of RESEARCH, DEVELOPMENT, DIFFUSION, or EVALUATION. (In 
Format 1 and 2 profiles, all outputs are classified in terms 
of an RDD or E focus.) 

OUTPUT FUNCTION. The attributes of an output that mark it as serving 
a POLICY, MANAGEMENT, or PRODUCTION FUNCTION. 

OUTPUT INDEX. An annotated listing of the outpjts of a project. 

OUTPUT LEVEL. The attributes of an output that identify its relationship 
to project goals as FOCAL, COMPONENT, or FACILITATING. 

OUTPUT MAP. A graphic portrayal of the functional interdependencies 
among the outputs of a project. 

OUTPUT STANDARD. A criterion applied to, or level of excellence expected 
of, an output; a criterion by which the adequacy of an output 
is judged. 

POLICY FUNCTION. A classification given an output that establishes 
standards or guidelines for a project. 

PROCESS/OPERATIONS STANDARDS. A criterion applied to, or level of 

excellence expected of, the proc .sses/operations engaged in 
in producing an output; a criterion by which the adequacy 
of processes/operations are judged. 

PRODUCT. A tangible or "hard" outcome of work effort, concrete in 
form, and transportable at a given point in time. 
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PRODUCT TON FUNCTION. A classification given n output that is a part, 
of the total fabrication effort of a project. 

PRODUCTION MANAGEMENT RESPONSIBILITY.* Responsibilities which, when 
carried out, result in outcomes that t -'bailee or facilitate 
the generation of products for which the project is responsible. 
(Subsequently, only the. outputs of these responsibilities were 
analyzed. ) 

PRODUCT TREE or PRODUCTION RESPONSIBILITY TREE.* A graphic portrayal 
of the functional interdependencies among the products of a 
project (equivalent to an OUTPUT MAP, except it contains 
only PRODUCTS) . 

PROJECT. A formally recognised, funded and directed effort aimed at 

achieving one or more specified ends that have their definition 
in educational RESEARCH, DEVELOPMENT, DIFFUSION, and EVALUATION. 

PROJECT COMPLEXITY. A project dimension defined in terms of level of 
funding and duration. 

PROJECT CONTEXT. A project dimension defined in terms of institutional 
setting, e.g., schools, colleges and universities, publicly 
supported laboratories and R&D centers. 

PROJECT FOCUS. A project dimension defined in terms of primary emphasis 
of work effort, i.e., RESEARCH, DEVELOPMENT, DIFFUSION, and 
EVALUATION. 

RESEARCH. A problem-solving strategy designed to produce reliable 
KNOWLEDGE, that is, facts, principles, theories, and laws 
that are generalizable and that can stand the test of 
empirical verification; also used to designate the focus of 
projects (see Project Focus ) and the focus of outputs (see 
Output Focus ) . 

SENSITIVITY. A classification given an ENABLER that identifies it as 
an increment of awareness about an environment or factors 
operating in or upon an environment; also, attitudes and 
personality characteristics. 

SKILL. A classification given an ENABLER that identifies it as an 
ability, proficiency or ex* ertness in the exercise of an 
art, craft, or science. 

STANDARD. See Output Standard and Process /Operations Standard . 

STRUCTURE OF ENABLERS. A classification given ENABLERS that identifies 
them as KNOWLEDGES, SKILLS, or SENSITIVITIES. 

STRUCTURE OF OUTPUTS. A classification given OUTPUTS that identifies 
them as PRODUCTS, EVENTS, or CONDITIONS. 
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STRUCTURE OF STANDARDS. A classification given STANDARDS that identifies 
them as OUTPUT STANDARDS or PROCESS/OPERATIONS STANDARDS. 

TASK. A unit of work performed in producing a specified OUTPUT to a 
specified STANDARD. 

TECHNOLOGY. A classification given an output of DEVELOPMENT, i.e. , an 
instance of a plan, procedure or product that when applied 
can bring about a desired end with a known degree of reliability 
the objective of DEVELOPMENT. 

TREE. See Product Tree . 

UTILIZATION. A circumstance in which KNOWLEDGE, INFORMATION, and/or 
TECHNOLOGY is employed in accomplishing a goal or end state. 
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traditional organizational form to a unitized pattern that incor- 
porates differentiated staffing. 



A PROJECT OF: Center for Advanced Study of 

Educational Administration 
University of Oregon 
Eugene, Oregon 97401 



O 

ERJC 



42 



2 



This profile has been prepared according to 
PROFILE FORMAT No. 3 

Three profile formats are represented in this volume. 
The reader should refer to this number when making 
use of the reader’s GUIDE to the profiles. 
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Chapter I: Overview 



This chapter is a brief introduction to the project "Improving 
Organizational Processes in Unitized Elementary Schools" ("Unitized") 
conducted at the Center for Advanced Study of Educational Administration 
(CASEA) , University of Oregon. 




Synopsis of the Project 

Title: Improving Organizational Processes in Unitized Elementary 

Schools . 



Responsible Institution: University of Oregon, Center for Advanced 

Study of Educational Administration. 

Funding Sources: 1. U.S. Office of Education, National Center for 

Educational Research and Development. 

2. University of Oregon, Graduate School. 

Funding Duration: July 1970 to June 1971. ^ (12 months) 

Observation Date: February 1971. 

Present Stage of Development: Mid-Project 

RDD&E Focus of Project: Educational research. 



Project Target Group: Faculty of elementary schools. 



Expected Outcomes: 



1. Final project report on "outcomes of four different 
methods of preparing for differentiated staffing 

in 10 elementary schools." 

2. A handbook containing descriptions of methods and 
outcomes from project reported herein, as well as 
one other project in CASEA and several outside 
CASEA. 

3. Two doctoral dissertations. 

4. One or more professional journal articals. 



Level of Funding and Duration: Low-Medium. (level 2 of 7 levels) 



Agency Setting: Research and development center. 



Staff Summary (current) : 

Total Full Time Equivalency in 
man years (interviewees only): 
Number of Personnel Assigned: 



Professional 



1.55 

12 



Support 



5 



Professional Specialities of Staff (interviewees only); social psychology (2) 
and guiclance/counseling (2) . 



This timeline constitutes an approximation only as projects in the agency 
are not funded on a time basis, but rather on the basis of need. (See 
Chapter V for further explanation.) 
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Objectives, Rationale, and Significance of the Project 

One of the ongoing activities at the Center for Advanced Study of 
Educational Administration (CASEA) is Program 30. This program is concerned 
with developing a training approach for helping schools change organiza- 
tionally. Referred to as ''Organizational Development , " this approach 
involves training the entire faculty of a school in communication skills, 
developing group processes in problem solving and decision making, and 
diagnosing difficulties that a group may be having in communication. 

The process of this diagnosis and training is called "intervention." 

The "Unitized" Project, within Program 30, is an attempt to apply 
this general training strategy to a specific kind of school organization. 
This organization is referred to by the various labels of "multiunit 
school," "open school," "team teaching school," or "differentiated staffing 
school." Basically j this is a school in which teams of teachers are 
responsible for teaching and/or decision making about large groups of 
students . 

Some of the advantages claimed for the unitized staff are faster 
adaptation of curriculum and instructional innovation, more flexibility 
in grouping and in using teachers with different skills, and greater 
variety of teachers and resources available to the student. 



It may be difficult to introduce this kind of organization into 
a school whose staff have developed few appropriate expectations or 
skills for team work or group problem solving and decision making. 
Therefore, this training strategy is designed to help in this tran- 
sition. 

The "Unitized" Project is specifically directed at determining 
the smallest portion of a faculty that can be trained in organizational 
development, to effectively enable a school to change to utilization. 

The design for this project, as outlined in the proposal, "will 
test directly and systematically the efficacy of four methods of 
intervention: (a) organizational training with the entire staff, 

(b,) group-development training with the principal and the unit leaders, 
(£) leadership training for the principals (only), and (d^) no inter- 
vention at all." 

The primary output of the project, as identified in the proposal, 
will be "a report on outcomes of four different methods of preparing 
for differentiated staffing in 10 elementary schools" that will be 
titled Organizational Development in Elementary Schools . 
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Context in Which the Project Operates 

Relationship to other agencies . The University of Oregon, its 
Graduate School, the Institute for Community Studies, and CASEA provide 
various organizational services and sanctions, as well as fiscal ac- 
countability to the project. Figure 1 represents the organizational 
context in which it functions. 

Funding in CASEA is for an entire program rather than by individual 
projects. An annual contractor’s request is prepared that summarizes 
the progress and proposals for all of the program rather than by separate 
projects. This goes to the U.S. Office of Education (USOE) from whom most 
of the financial support for the work carried out in CASEA is obtained. 

Another program in CASEA is Program 20. Titled "Organizational Im- 
plications of Instructional Change," it is especially concerned with 
instructional innovations such as differentiated staffing. It is 
expected that Program 20 will collaborate with the "Unitized" Project 
in the collection cf data in some of the participating schools. This 
has a mutual benefit for both programs, providing extra manpower for 
this project and needed data in Program 20. 

This project has an informal relationship with the National Train- 
ing Laboratories (NTL). Data will be collected in local schools which are 
attempting to change to unitized staffing, and where only the principal 
has taken training at NTL. There are no formal agreements between NTL 
and this project. 

At the time of observation there were six participating elementary 
schools in the project’s training program; two in the organizational 
development intervention method and four in the group development inter- 
vention method. Eight to as many as 20 more schools were expected to 
become involved in the project before its planned conclusion in April 
1973. 



Time lines . Figure 2 is the schedule for the "Unitized" Project 
as it appeared in the proposal. The first phase of training was an 
intensive one week workshop held in late August 1970 preparatory to 
the start of school. The second phase of training was held in the 
schools during school time and can be viewed as implementation of 
unitized staffing and change strategies. 

Physical/environmental setting . This project is being conducted 
solely within and from the offices of CASEA on the University of Oregon 
campus. All of the participating test schools are located in the 
local community. Proximity of the test schools reduced staff travel 
time to a minimum, and the university campus location offers research, 
library, and computer facilities. 
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Chapter II: Parameters of the Project 



This chapter presents the staffing pattern of the project and describes 
briefly these outputs which were interviewed around. It also displays those 
interdependent relationships of all identified project outputs in an output 

map . 



Project Structure 



Staff s tructure * Figure 3 represents the organizational structure of 
the "Unitize V Project. The project has a dual leadership. The Director 
and Co-Dire cor share the leadership and management responsibilities for 
the project. To a lesser extent, the Research Associate, also a full time 
faculty member, shares in the activities at this level. The nine graduate 
assistants provide manpower for the project and participate in production 
management. The purposes of the project serve its own interests, as well 
as providing a supervised setting for the training of educational R & D 
personnel. Further staffing of this project included the support of two 
secretaries, two coders, and a librarian. 




Project organizational structure. 




n 7 



FIG. 3. 



Two school district coordinators work some 2G% of their time with 
this project. They are considered adjunct members of the staff, receiving 
no salary from the project. Their primary function is to serve as liaison 
with the educational R & 1) community as representatives of the schools* 
interests . 



On this project, it is estimated that an attrition rate for staff 
during *70, *71, ana *72 will be between 16% and 30%. The planned total 
duration of more than three years for the overall project would tend to 
assure a significant turnover among the research assistants (graduate 
students), but not for the senior staff. 



None of the people working on this project are assigned full time. 
All have responsibilities to other projects in Program 30 or to projects 
in other programs of CASEA. The Project Co-Director for the "Unitized** 
Project is also Director of Program 30 in which the project resides. 



Project roster . The following staff members were interviewed 
for information about the project and its selected outputs. 



Staff Interviewed Outputs Interviewed 

Project Director : A social psychologist E-01.^ Laboratory Training 

with experience in organizational change. Program (Field test of 

Responsible for conception and initiation intervention methods) 

of this project while sharing with a 
colleague the responsibilities of managing 
and production within the project. FTE^ ,4 u 



Pro 1 ect Co-Director : A social psycholo- 

gist with an experimentally oriented 
background. Shares responsibility with 
the Director for management and produc- 
tion within project. Gives considerable 
attention to the budget, personnel, and 
data analysis. FTE .40 



E-08. Project Progress: 
Maintaining of 
E-09. Project Budget: 
Maintaining of 

E-10. Staff Hiring: Graduate 

Research Assistants 



Research Assistant ; A graduate student P-02, 
at the doctoral level with speciality in 
counseling psychology. Responsibilities P-03, 
lie in training of the field-test site 
personnel, data collection, and generally 
supporting the work of the project. C-04. 

FTE .50 



Interaction Observation 
Form 

Inhouse Memos: Test 

Schools Training Visit 
Reports . 

Test Schools' Personnel 
Welfare 



2 

3 



FTE (Full Time Equivalency) 

See "Index of outputs" for description of output identification 
number . 



Li 



K-05. Training Sessions: 
Group Development 
intervention Method 
E-06. Observations Coor- 
dinating: Test 

Schools' Faculty 
Interaction 

P-07. Summary Reports: 
Inhouse Progress 
Reviews 

The following staff members complete the list of project personnel. 

These people were not interviewed in this study. 

Research Associate (senior project staff) : Had recently joined the 

project staff at the time of observation. Primarily responsible 
for project output utilization plans. 

Research Assistants : In addition to the two research assistants 

interviewed, there were seven other graduate students on the project 
staff, all carrying responsibilities very similar to those mentioned 
above for the research assistants who were interviewed. 



Research Assistant : A graduate student 

at the doctoral level with specialization 
in counseling psychology. Responsibili- 
ties in training of field-test site 
personnel, coordination of observation 
teams, data collection, and generally 
supporting the work of the project 
wherever skills most useful. FTE .25 



Outputs Generated 



During the observation and interview period on the "Unitized" Project, 
40 significant outputs^ were identified and formal interviews were conducted 
around 10 of them. Those project personnel who were linked to these 10 
selected outputs were interviewed about their roles in generating them. 

The selected outputs are annotated and sutonarized in the following section. 

Index of outputs . An arbitrary identification number has been given 
to each of the 40 outputs and is composed of two parts: (a) a letter which 

permits easy identification of the output as either a product (P), condition 
(C) , or event (E)^, and (b) a sequence number for all outputs irrespective 
of P, C, or E. 



4 An identifiable and significant planned outcome (product, event, 
condition) of targeted work activities, with targeted work activities 
being actions directed toward the realization of projected goal states. 

Product - A tangible or "hard" outcome of work effort that survives 
in a form that is transportable, such as a report. 

Event - An outcome of work effort that results in the occurrence 
of an observable transaction, such as an interview. 

Condition - An outcome of work effort that results in the creation 

of a desired circumstance, such as fiscal responsibility. 
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E-01 . Laboratory Training Program (Field Test of Intervention 

Method) . Field test in selected elementary school facul- 
ties of the Organizational Development and the Group De- 
velopment intervention methods. 

P-02. Interaction Observation Form: Evaluative . Interaction 

classification tally form used by observers of group process, 
i.e., meetings, etc. in the field-test schools. 

P-03. Inhouse Memos; Test Schools Training Visits Reports . 

Reports prepared by training team leaders which note 
the processes and progress in the field-test schools 
toward uni tization. 

C-04. Test Schools* Personnel (Trainees) Welfare . Support and 

guidance provided to the school faculty members during the 
implementation of organizational development strategies. 

E-05. Training Sessions: Group Development Intervention Method . 

Training sessions with the Principal and unit leaders of 
a school that included organizational diagnosis and feed- 
back, intergroup and interrole confrontations, and increase 
of group problem-solving skills. Special emphasis given 
to team building and communication skills training. 

E-06. Observations Coordinating: Test Schools 1 Faculty Interaction . 

Maintaining and managing people to efficiently collect group 
behavior data in the test site schools. 

P-07. Summary Reports: Inhouse Progress Reviews . Inhouse memo 

summarizing the major events, themes, and assessment of 
progress for a specified period. 

E-08. Project Progress: Maintaining it . The assurance and 

monitoring of work flow# 

E-09 . Project Budget: Maintaining it. Monitoring of expenditures 

against project progress and requirements. 

E-10. Staff Hiring; Graduate Research Assistants . Approximately 
two or three graduate assistants are hired each year. 

Output map . Figure 4 graphically represents the dependency relation- 
ships of the 40 identified outputs of this project. 
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Chapter III: Summary of the Data 



Data were gathered through interviews around the selected outputs 
described in Chapter II, The interviews sought to elicit for each out- 
put to be analyzed the standards by which the satisfactory completion of 
the output is judged, the tasks required to generate an output meeting 
those standards, and the enablers (knowledges, skills, and sensitivities) 
which facilitate the carrying out of those tasks. The cables included 
in this chapter summarize the output data of these three categories by show- 
ing the frequency with which an item of interview information was cited 
within each one. 

Within each category are a series or set of descriptive labels 
which are representative of interviewee statements (raw data) within a 
particular category. These descriptive labels are listed in the table 
under the category heading. In the process of reducing raw data, nar- 
rative interviewee statements about an output were linked to one of the 
three major categories. Each narrative statement was then classified by 
means of a number code according to the most representative descriptive 
label within a given category or subcategory. 

Each table, therefore, provides the frequency with which interviewees 
cited specific statements (which are represented by the descriptive labels 
in the tables) of standards (Tables 1 and 2), tasks (Table 3) and 
enablers (Tables 4, 5, 6) in relation to the outputs that are listed.^ 



Output Analysis 

Standards held for outputs . Tables 1 and 2 summarize the standards 
for outputs that the interviewees cited. Table 1 is the output standards 
(coding set J-l) and Table 2 is the process standards (coding set J-2). 

In Table 1, about one-half of the output standards cited cluster under 
the category "Goal attainment" for the output "Laboratory Training 
Program." The remainder of the standards are scattered. Output P-02, 
"Interaction Observation Form: Evaluative," had standards cited in five 
categories. The project was very much involved in the training program and 
data collection at the time of observation and this is reflected in the 
table. Table 2, the process standards cited by the interviewees are 



^If the reader is interested in the narrative statements of the inter- 
viewees (raw data), these can be found in the Appendix. To locate the 
narrative statement for any given category, first note the output and its 
identification number in the table. Second, note that each descriptive 
label within a given category has a distinct number or code. Turn to 
the Appendix and locate the output. Under the output locate the category 
label or heading (standard, task, or enabler) and pinpoint the number or 
numbers depending on frequency cited) of the descriptive label which 
appeared in the table. The statement in the Appendix opposite this number 
is the original narrative statement from an interviewee and is only re- 
presented in the table by the descriptive label and its nUraber coding. 
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01 Completeness of content 

04 Communication and clarity 

05 Utility or value 

07 Personal satisfaction/feeling 

12 Goal attainment 

13 Acceptance by others (in proj) 
16 Compares favorably 

21 Sources of variance controlled 

22 Functions as planned 
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Mrut. Li-ri'fJ and only L/itegory 0/, M An expected activity occurs, " is 
cited in more Llian one output. Output E-O'j, "Training Sessions: 

(Jroup development intervention Method, 11 has standards cited in more 
than two categories. 

Tasks pertaining to output attainment . Table 3 summarizes the 
tasks cited by interviewees as relevant for the attainment of re 1 ited 
outputs. More than one-third of all tasks cited are in Output E-01, 
’’Laboratory Training Program," while the task categories with the high- 
est frequencies are numbers 31, ’’Diffusing within project;” 22 , ’’Effect- 
ing accountability;” and 05, ’’Collecting, processing data.” This 
reflects the field setting nature of this research project. 

Enablers pertaining to output attainment . Table 4 summarizes the 
knowledges cited by interviewees that enable them to develop particular 
outputs. Categories 03, ’’Subjects related to RDD&E, ” and 04, ’’Technical/ 
professional topics,” were the only categories included in more than one 
output . 

In Table 5, the enabling skills indicated by the interviewees as 
important to their work on an output are mostly related to instrument 
design, data collection, administering instruments, and analysis. 

Table 6 summarizes the sensitivities the interviewees cited as 
enabling them to conduct their output activities effectively. Again, 
as is common in the other tables, most of the sensitivities are cited 
for Output E-01, ’’Laboratory Training Programs.” The reader should 
be aware that all of the data collected around this output comes from 
an interview with one person. It is assumed that his high degree of 
involvement in this project accounts for the great amount of information 
given that occurs under this output. But in looking at the table, the 
category most often cited is 22, "Responses of target audiences.” This 
would seem to reflect the people-oriented, group processes emphasis 
which appears to characterize this project. 
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This chapter contains information about output characteristics, the 
backgrounds of the staff, and the training and resources needed for carry- 
ing out the job activities within the project. 



Classifications of Output Characteristics 

Outputs may be categorized in terms of a number of variables. Among 
them are (fO Structure (product, event, or condition), (jb) Function (policy 
setting, management, production), (£) Character (knowledge, technology, 
implementation 9 or information), (d ) Level (focal, component, or facili- 
tating), and (ej Stage of completion. These five schema are represented 
in Table 7 for each project output identified, with frequencies summarized 
for each category. 



Summary of Staff Backgrounds 

The information in this section is based on the questionnaire re- 
sponses of the four staff members who were interviewed from Project 
"Unitized." 

Highest degrees attained . Of the four staff interviewed, the 
Project Director and Co-Director held doctoral degrees in social 
psychology, and the two graduate assistants held master’s degrees in 
guidance and counseling. Both graduate assistants ware in doctoral 
programs in counseling psychology. 

National professional memberships . The staff indicated memberships 
in the following professional organizations: 

1. American Educational Research Association. 

2. American Psychological Association. 

3. Society for General Systems Research. 

4. American Statistical Association. 

5. National Training Laboratories - Institute for Applied 
Behavioral Science. 

Prior work experience . Table 8 displays the distribution of total 
work experience of the four staff interviewed within eight work setting 
categories. (It should be noted that the Project Director has indicated 
that two persons have more than four years of experience in other work 
settings; however, this was not indicated in the original data and 
therefore is not reflected in Table 8.) 
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TABLE 7 



Classification* of Output Characterise ics 















Output 


Characteristic 9 










Prolect Output* 


Structure 


Function 


Level 


Character 
(Products only) 


Comp let ton 


Stage 


Nq. 


Label 


P „ 


a 


c 


ns a 


p 


t\ 


_c 


f 7, 


k t ii 12 


12 3 4 


* 


6 


*E-01 


Laboratory Training Program (Field 
Teat of Intervention Methods) 




X 




X 








X 




X 






*P-02 


Interaction Obaervatlon Fora: Evaluative 


X 






X 








X 


X 


X 






*P-03 


Inhouae Memos : Teat Schools Visits 

Reports 


X 






X 








X 


X 


X 






*C-04 


Tc it Schools Schools ' Personnel (Trainees) 
Welfare 






X 


X 








X 




X 






*E-05 


Training Sesalona: Group Development 

Intervention Method 




X 






X 




X 






X 






*E-06 


Observations Coordinating: T* Schools' 

Faculty Interaction 




X 




X 








X 




X 






*P-07 


Summary Reports: Inhouse Progress 

Reviews 


X 






X 








X 


X 






X 


*E-O0 


Project Progress : Maintaining i ; 




X 




X 








X 








X 


*E-09 


Project Budget: Maintaining it 




X 




X 








X 








X 


*E-10 


Staff Hiring: Graduate Research 

Assistants 




X 




X 








X 








X 


P-11 


Proposal: Research Design 


X 






X 








X 


X 


X 






C-12 


Project Staff Welfare 






X 


X 








X 








X 


C-13 


Community Relations: General and 

Professional 






X 


X 








X 








t 


P-14 


Organizational Development Training 
Intervention Method (Full Faculty) 


X 








X 




X 




X 


X 






E-15 


Training Sessions: Organizational 

Development Intervention Method 




X 






X 




X 




* 


X 






E-16 


Observations Coordinating: Test Schools' 

Faculty-Student Interaction 




X 




X 








X 




X 






P-17 


Handbook: Manual of Organizational 

Development Techniques 


X 








X 


X 






X 


X 






P-18 


Intervention Schedules: Workshop 

(Training Programs First Phase) 


X 






X 








X 


X 


X 






P-19 


Data from Schools Where Principal 
Only Is Trained 


X 






X 








X 


X 




X 




P-20 


Ph.D. Dissertations (2): Project 

Technical Reports 


X 








X 


X 






X 


X 






P-21 


Journal Articles: Professional 

Technical Reports 


X 






,2 * 




X 






X 




X 
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TABLE 7 concluded 

Ciaaalflcatlona of Output Characteristics 















Output 


Charat rarli tic* 














Project Outputs 


Structure 


1 I 

Function 


! 

level 


Character 
(Products only) 


Completion 


Stage 


No. Label 




e 


c 




P 


f 1 


c 




k _t li 1, 


1 


2 


3 4 


5 


6 


P-22 


Projact 3002 "Unit Had'* Final Report 


X 








X 


X 






X 








X 




8-23 


Training Workshop: Training Programs 

Flrat Phase 




X 






X 




X 








X 








P-24 


Handbook Outline (ae^ Output 17) , 


X 








X 




X 




X 




X 








P-25 


Interview Schedule (Guide): Diagnostic 

(Ravlaed) • 


X 






X 








X 


X 




X 








P-26 


Pretaat Data 


X 






X 








X 


X 






X 






P-27 


Interview Schadulaa (2 Guidee) : 
Evaluative (Revised) 


X 






X 








X 


X 




X 








P-28 


Questlonnalraa (3): Evaluative (Ravlaed) 








X 








J 


X 




X 








E-29 


Data Analysts 




X 




X 








X 










X 




P-30 


Check Lie ta; Prograaa Monitoring 


X 






X 








X 


X 










X 


E-31 


Staff Task Assignments 




X 




X 








X 












X 


C-32 


Vork Quality Maintenance 






X 


X 








X 












X 


P-33 


Posttest Data 


X 






X 








X 


X 








X 




C-34 


Coordination with Other Projecte 
In Program 






X 


X 








X 












X 


E-35 


Negotiating with Field Test Schools 




X 




X 












X 










P-36 


Group Development Training Intervention 
Method (Principals and Unit Leaders) 


X 








X 




X 




X 






X 






P-37 


Data from No Intervention Schools 


X 

< 






X 








X 


X 








X 




B-38 


Staff Mea tinge 




X 




X 








X 












X 


B-39 


Policy Decisions: Senior Projact 

Staff 




X 




’ X 








X 












X 




Intraagcncy Communication 






X 


X 








X 












X 


b 

Claeeif ication Fraquenclaa 


21 


14 


• 


1 30 


9 


4 


6 


30 


2 11 2 5 


2 


6 


1 12 


6 


13 



The specific output 


characteristics are 


identified aa follows: 








Structure 


Function 


Laval 


Character 


Completion Stage 




p - product 


ps - policy setting 


fl - focal 


k - knowledge 


1 - compJatcd over one year 


ago 


c - event 


■ - management 


c - component 


t - technology 


2 - completed 3 to d2 months 


i ago 


c “ condition 


p - production 


fl - facilitating 


il - implementation 


3 - completed within laut 3 


mo a . 








12 ** information 


4 - currently in progress 












3 - not yat underway 












6 - on going (continuous) 





Data totala In thla tabia aay vary alight* ' from data in tablaa rcportad elsewhere. Thla 
la a function of daciaion rule* *overning cleaaif ication of output* having baan ravlaad and 
applied to these date Subsequent to tha preparation of the profile* 
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TAfJLE 8 

Distribution of Staff Work Experience within Work Setting Categories 







Amount of 


Experience 




Work Setting 


No 

Exper- 

ience 


Less 
than 
1 yr. 


1-4 

years 


5 or more 
years 


In R, D, D, or E Work 


0 


0 


2 


2 


In Administrative Wor.v 


1 


0 


0 


3 


In College Teaching or Research 


0 


0 


2 


2 


In Public Schools 


2 


0 


1 


1 


In State or National Education 










Agenc ies 


4 


0 


0 


0 


In R & D Centers 


0 


0 


3 


1 


In Present Organization (may be 
concurrent with other areas 










above) 


0 


0 


3 


1 


In Other Work Settings 


3 


0 


1 


0 



Summary of Interviewee Responses 

Present position requirements . Four questions asked of the four 
interviewees are stated below with their responses. The responses are 
listed by type of position held by the respondent. 



Question 1: What specific knowledges and skills does (your) po- 

sition require? 



Project Managers 

1. Knowledge of social psychology of organizations and small groups. 

2. Knowledge of organizational development training action research 
techniques . 

3. Knowledge of research methods in human behavior in organization. 

4. Interpersonal communication. 

5. Group problem solving. 

6. Ability to deal with emotions of staff and “customers 0 as 
information, not as an extraneous embarrassment. 
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Project Staff 

1. How to relate to people. 

2. How to write clearly and concisely. 

3. How to recognize own feelings toward others and use them 
constructively. 

A. Training skills — how to lead a group in the accomplishment 
of a task. 

5. Design skills — how to plan for interventions (training). 

6. Research skills — how to evaluate what has happened. 



Question 2: How many years of work experience does (your) position 

require in educational research, development, dif- 
fusion, and/or evaluation? 



Project Managers 

One to four years experience. 

Project Staff 

No previous RDD&E experience was necessary. 



Question 3: How many years of work experience does (your) position 

require in administration or management? 



Project Managers 

Some, but less than one year. 

Project Staff 

No previous administrative or management experience was necessary. 



j Question 4: Academically (ycur) position requires which degree? 

i 



Degree Level Inter- 

Degree Level of viewees Indicated 

Position Title Interviewees Position Required 



Project Managers Doctorate 

Master 1 s 



Doctorate, "but to do the 
work, degrees are irrelevant." 



Project Staff 



Master 1 s , bachelor * s 



Suppo rt res ources. The service and equipment resources used by the 
personnel on tills project were: 

1. Support services used: 

(a) Equipment construction (mechanical, electronic, carpentry, 
etc . ) . 

(b) *Printing. 

(c) Otuer reproduction services: M mimeo, Xerox, ditto." 

(d) Photography. 

(e) *Art work and illustrations. 

(f) Drafting. 

(g) *Technical writing. 

(h) *Edi ting. 

(i) *Secretarial service, o -her than typing. 

(j_) *Typing. 

(k) *Purchase of supplies and equipment. 

(l) *Library holdings. 

(m) *Subscriptions to technical and professional j ournais/periodicals . 
Cn) *Requests for documents or publications not locally available. 

(o) ^Computer analysis services (data processing^. 

(£) *Computex- program writing. 

(q) *Statistical consultation. 

(_r) Audio-visual aids and devices. 

(s) ^Subjects for experimentation or try-out of procedures. 

(t) ^Travel arrangements. 

(u) ^Budgetary and other fiscal accounting. 

(v) ^Scoring of test items. 

(w) Television facilities and equipment. 

(x) Othe : "consultants . " 

*Support services considered by one or more interviewees as highly critical 
to carrying out the work of the project. 

2. Support equipment used: 

(a) Dictating equipment. 

(b) Desk calculators. 

(c) Onsite computer. 

(d) Key-punch machine. 

(e) Data card sorter. 

CO Readers of microfiche and microtilm. 

(g) Other significant equipment: "typewriter, telephone mimeograph, 

library." 



General activity significance . By questionnaire, project personnel 
interviewed were asked to rate several general activity categories and 
associated specific activities on a 0 to 7 scale. The scale represents 
the amount an activity plays a part in the respondent’s project work from 
0 , "Definitely not a part of my project activity, does not apply," to _7, 
"A most significant part of my work." 



Ratings by Position 
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Chapter V: Project Dynamics 



The Project 

The life of Program 30, as other programs in CASEA, depends on 
its projects. The program provides a general definition of research 
goals within which projects can be developed and conducted, and it 
provides goals and resources that the individual project can call 
upon, but in itself it is only an organizational structure. 

When looking at a project within a program context it is very 
difficult for the observer iri a brief time to identify precisely 
its parameters. The various inputs, overlaps, and interactions 
cloud the picture considerably. But the benefits of such a context 
are obvious in the coherence of goals that the program can provide 
for its projects . 

During an interview it was indicated that some work done on the 
"Unitized" Project this summer (1971) will feed into a new project. 

This is important in understanding the program context of this project. 
The research effort is an ongoing effort with the limits of one pro- 
ject overlapping and feeding into another. Ideas based on previous 
experience are developed into a project that produces more ideas for 
more projects. So a project is not seen as a neatly defined unit of 
activity, but rather a cluster of activities feeding out of previous 
work and sprouting additional work. Consequently some of the outputs 
of this project are not solely dependent on work in this project, and 
in this sense the project origin cannot be precisely dated. For ex- 
ample, the handbook or manual that will be written at the conclusion 
of the project will rely heavily on input from other projects in CASEA 
and Program 30, as well as input from work going on outside the agency. 

The sequence of outputs of this study are, of course, directly 
related to the sequence of functions defined in the research design. 

1. Designing and developing research strategies. 

2. Evaluation of four intervention methods. 

(a) Group development method. 

(b) Organizational development method. 

(c) Principals only trained. 

(d) No intervention. 

3. Analysis of data. 

( a ) Theory testing. 

4. Reporting. 

5. Refining of intervention (training) techniques. 

During the evaluation of the four intervention methods (the second 
function above), there is anticipated collaboration with a project in 
Program 20. This association will apparently be one where the project 
in Program 20 will collect data in some of the schools participating in 
the "Unitized" Project. This data will be used in both projects. 



11m- n J.-iV ] Jp u \ tin- project staff to tin- field-test schools 
is not slriMly a resea rcii-JLike association. The selection of a school 
must have more payoff than simply being a research subject. Jn this 
project this could be a major problem if not properly handled. How- 
ever, two factors seem to make the relationship between the project 
staff and the schools more than just a research association. First, 
all the schools participating either initially requested or showed 
interest in gaining help from CASEA in organizational change. Second, 
due to this type of entry into the schools, the project staff function 
mostly as consultants . 

The consultant-type approach used by the program in its field-site 
interface with schools has provided for a building of a basic reper- 
toire of techniques in group dynamics, games, and data collection in- 
struments that are used and modified from project to project. The 
impression is that practice and development occur simultaneously. 

The training that occurred in the first phase of the intervention 
training program (workshop) required a consultant role that was directive 
and somewhat promotional. However, during the second phase of training 
(in the schools) the sessions have become more observational in nature 
and the trainees 1 roles have become more that of supportive observers. 

Built into the training program are diagnostic data feedback loops. 
These allow the trainers to modify training strategies to meet needs 
or problems as they arise. 

The support services available to this project seem very adequate. 

In addition to secretarial and clerical services, the project has use of 
CASEA* s library and continuous use of computer facilities on campus. 



The Setting 

The offices of the project staff are located on the second floor 
of a remodeled dormitory building on the university campus. The hall- 
ways are narrow, mostly gray in color, and so maze-like that one unfa- 
miliar with them caii easily become lost. The offices themselves are 
rather small. 

All the offices are clustered together along a short hallway. A 
large conference room is available directly adjacent to the offices, 
and a secretary is located nearby in an enlarged section of the hall- 
way. Most of the noise one hears in the offices is the muffled clacking 
of a typewriter or the footsteps and voices of people in the hall. 



The Management Style 

The Project Director and Co-Director share the management respon- 
sibilities of this project. The Director is more concerned with the 
technical aspects of social innovation and generating ideas and designs, 
while the Co-Director handles many of the pure management tasks of the 
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project such as budget, personnel, etc. This provides an interesting 
match of personalities that seems to work quite well in that they ap- 
pear to coordinate their interests and inclinations very effectively. 

Between them, they provide the basic project management and policy 
within which the project staff functions. However, the whole staff 
is involved in providing the production management routines and schemes, 
as well as accepting individual work assignments for getting the outputs 
or this project generated. 

Most of the staff have tasks in more than one area of responsibility. 

The Directors not only determine the basic organization for project manage- 
ment and set the policy or philosophy of the project, but they also 
participate in production management and in the actual production of 
outputs. The graduate assistants’ tasks include training, designing 
of intervention schemes, and writing. There is considerable overlap 
of people on tasks, except in training and interaction observation. The 
observation task is only done by nontrainers. This is a result of experience 
from earlier in the project when this task was done by trainers. 

The Directors maintain relationships with NTL; one being a fellow 
and the other a professional member. They expect to use a group of 
principals, trained in organizational development by NTL, as one of 
the control groups for this project. This is an informal relationship 
that they will use for the purposes of this project. 

The Directors have attempted to build a closely knit research 
team. They claim that they want an intimate working relationship 
among all the staff, one that is characterized by open and honest inter- 
action. The people should know themselves and their problems very 
well and be willing to have other members of the staff confront them 
about these problems. An essential aspect of uhe dynamics of this 
project is its group process and teamwork. The project is both 
informal and systematic. 

Most of the work planning and allocation of responsibilities take 
place in the weekly project meetings. Chairmanship for these meetings 
rotates weekly among the 12 staff members so that all have an opportunity 
for this experience. In these meetings the discussions range from 
staff work problems to what hac to be done next on the project. Work 
could be allocated on a variety of bases: (a) whoever is available at 
the time, (b) who has the most experience, (c) who needs and wants the 
experience, and (d) such that all members get equal exposure in front 
of site personnel — to build site personnel confidence in all project 
staff personnel. 

Beyond the communication that takes place in meetings juch as those 
described above, and informally in someone’s office or by chance meeting, 
communication in the project is maintained by memorandums. Thesa 
are prepared after each test school visit by training team members 
for various project functions concerning the whole staff. Periodically, 
the training team leaders are requested to submit a summary report 
that serves as an inhouse monitoring of project progress. 
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Issues 



Probably no project will ever be free of problems or concerns, and 
the "Unitized" Project is not unique in this respect. During the training 
program, two of the six schools that were participating in the group 
development intervention method dropped out of the project. Although 
this is of concern to the project, the fact that they dropped out is not 
a "problem," since part of the research being undertaken is to find out 
why schools drop out. As an R & D project within an R & D center, 
part of the purpose of the project, therefore, is to find out whether 
or not any school does drop out, and if so why. 

In the case of these schools, the causes of their dropping from 
the project are still under investigation. It appears that hard feel- 
ings developed between faculties and the principals, since the latter 
had selected participants for the program rather than having the faculty 
select them. Generally, however, there have been more applications for 
participation than can be handled. 

Another issue facing the project is that the school district in 
which most of the participating schools reside cannot, they feel, 
provide money for remodeling in the schools that is important to the 
project's goals. Apparently many of the faculty in these schools are 
not willing to move toward the project goals until that money is avail- 
able. This issue is also approached by the project as part of their 
research, and it is not viewed simply as a problem to overcome. It is 
considered part of the purpose of the project to explore these occur- 
rences and to examine their nature. 





Chapter VI: Implications for Training 



This project provides a training setting for graduate students, 
as do all projects in CASEA. What is emphasized in training here seems 
to carry many implications for the training of educational R, D, D, 
and E personnel in general, and specifically of educational research 
personnel as found in the "Unitized" Project, 

All of the "Unitized" Project staff interviewed emphasized that the 
traditional laboratory training approach is not appropriate to the field- 
setting, action research they are doing. A "reasonable" amount of know- 
ledge about research design and procedures is necessary, but it must be 
applicable to "natural situations, not the rats in the basement." They 
feel that people heavily trained in the traditional research methods 
courses "are unable to go into the field because they cannot control 
things as they can in the laboratory." 

Much attention is given to controlled procedure in the laboratory 
setting research approach, but such attention to control as is possible 
in a laboratory would make the work of a project like this improbable. 

In action research one usually does not expect to have the same level 
of control as is possible in the laboratory. Nevertheless, the goals 
of an action research project such as this one are valuable to the 
solution of problems. Such goals should not be disregarded because 
the controlled laboratory research methods cannot rigidly be adhered 
to. Flexibility in procedure is one requirement for any level of success 
in reaching a goal in "natural situation" research. The goal, how- 
ever, must be well defined and remain firm, and a deuigr for reaching 
such a goal must allow for flexibility in proceudre. Thus, any training 
that is appropriate to this kind of research should include research 
courses that stress methods allowing flexibility, but still maintaining 
enough control to preserve the integrity of the research. 

This project also indicated a need for flexibility in the people who 
work in educational research. On the "Unitized" Project there was a con- 
cern that people tend to be either people oriented or data oriented and 
not many seem to be oriented to both. The Co-Director was concerned that 
lie was finding it difficult to locate people who were data oriented for 
this project while people that were people oriented, at least among 
graduate student applicants, were much easier to find. Ideally, over- 
lapping orientations within individuals would seem to make the better 
educational researcher. But the need for flexibility in people does not 
stop here. 

All the people on the "Unitized" Project were working on at 
least one other project. The average percentage of FTE assigned to 
"Unitized" over the four staff interviewed was 39%. The range was 
from 25% to 50%. As in other projects that this writer has visited, 
the personnel have been carrying concurrent commitments to two or 
more projects. This kind of multiple assignment need for flexibility 
should be reflected in training programs. 
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In the opinion of the staff interviewed on this project appropriate 
training programs would devote a large portion of time to giving students 
actual experience on several ongoing projects. The traditional class- 
room setting was not felt to be appropriate to this training. As one 
Director stated, "The best kind of training is to do something, to ex- 
perience something and then talk about it and read about it afterward." 

The other emphatically supports this opinion in his statement that 
training of educational R,D,D, and E personnel should be "doing, not 
just talking about it." 

The Directors of this project feel tha; the development of essential 
skills in working as a member of a team, or in coping with the emotional 
situations that are bound to arise, and developing the high level of 
sensitivities to interpersonal behavior essential to effectively working 
with people can only be gained in an actual, "live" experience. 

Actual project experience would provide the skill building 
experience as a team member. On this project the team approach is 
greatly emphasized. The very size and complexity of these activities 
require many people to pool their talents to accomplish their goals . 

"We have to maintair. our team in a highly communicative, mutually 
trustful situation where everybody understands the interactive nature 
of this kind of work intellectually and emotionally . " So a skill 
that a person needs to do this kind of work is the skill "to. be a 
member of a team that irteracts intimately." Actual project ex- 
perience could provide the skill building experience needed in 
project team effort. 

One of the skills highly emphasized on this project is the skill 
of writing. The ability to write clearly and concisely was highly 
prized. Although there was no apparent formal training procedure^ 
the Directors did edit and critique the various memorandums and reports 
the graduate assistants wrote. Their comments were highly respected 
and on occasion unsatisfactory work was returned to the author for 
rewriting. The importance of writing skill in educational research 
cannot be overemphasized in light of this project. It is an essential 
activity . 

From the vantage point of this project, the academic training set- 
ting is lacking in appropriateness as the sole setting for educa- 
tional research personnel. Appropriate training would give considerable 
opportunity to the student for actual project experience, with time 
in the classroom contributing to the experience. The teacher in such a set- 
ting would be a working partner with his students, exposing himself 
to the same situations and stresses experienced by those students. 
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Appendix: Listing of Output Standards, Tasks, and Enablers 



The following is a list of standards, tasks, and enablers for 
outputs around which interviews were conducted. These statements were 
extracted from discussions with interviewees and were coded into their 
respective category sets. The selected code precedes the statement and 
indicates the following for: 



STANDARDS 
Code J: 
J-l 
J-2 

Code LM: 
TASKS 

Code NO: 



Structure of Standards. 

Standards against which outputs are judged (output oriented). 

Standards against which processes and/cr operations are 
judged (process oriented). 

Primary Categories of Standards. 

Clusters of Tasks. 



ENABLERS 

Code S: Structure of Enablers. 

S-l Knowledge. 

S-2 Skill or ability to perform. 

S-3 Sensitivity or awareness. 

Code UV: Primary Categories of Enablers (knowledges, skills, or 

sensitivities) . 



The codes associated with these three categories (standards, tasks, 
enablers) are the same both here in the listing and as previously cited 
in Chapter III tables. 



Each of the 10 analyzed outputs is cited below within a rectangular 
box. Listed under each are the interview statements relevant to that 
output . 



E-01: Laboratory Training Program (Field Test of Intervention Methods) 



"In Organizational Training, we bring together the entire faculty of 
the school. The entire faculty is the target of the intf rvention; the 
administration, teachers, custodian, cooks. We are a disinterested medi- 
ator that tries to bring the various leve^s^nd roles into communication. 
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but because this is a rather extensive strategy for changing a school., 
we decided to compare it with a second level of intervention which we 
call Group DeV( lopmen t . Group Development compares historically with 
what people used to call Change Agent Teams. You take a subgroup of a 
faculty and train them to be highly cohesive and supportive of each 
other. Then heip them build a strategy whereby they go back to the 
faculty and try to bring changes in the school by implementing their 
strategy." 



STANDARDS 

J LM 

1 12 The school changes from a self-contained to a multiunit school. 

1 12 In the school teams of teachers develop, each with a team leader. 

1 12 In the school a "unit" of kids instead of grade classes becomes 

the organizer for instruction. 

1 12 In the school people meet regularly as a team and make decisions, 

1 12 In the school students identify with a unit. 

1 12 In the school students indicate they have several teachers. 

1 04 In the school faculty clear about goals. 

1 04 In the school faculty know what the role definitions are and 

are comfortable with it. 

1 12 In the school communications skills are used and use increases 

throughout the year. 

1 12 In the school use of systematic problem solving system rather 
than jump to conclusions is evidenced. 

1 12 In the school shaping and formalizing group agreements on how 

to work together occurs. 

1 12 In the school spend time periodically talking about interperson- 

nel processes rather than just the task for a sense of how they 
are feeling about their work. 

1 12 Classroom changes in relation to s tudent/teacher interactions 

as measured by Flander’s interaction analysis system such that 
more clusters in room setting arrangements occur, and achieve- 
ment/performance data (available from districts as a possible 
addition in the future) reflects improvements in growth pattern. 

2 30 Teacher turnover rates fall in the school. 

2 34. School desirability rating by potential teachers increases as 
indicated by number of inquiries. 

2 34 Increase in number of kids from outside the area served by that 
school. 



O 

ERIC 



TASKS : 

NO 

29 Maintain contact with school districts via demonstration, lec- 

tures, or as a consultant for events at which there are faculty 
and administrators. (Sometimes this is self-initiated ; sometimes 
at their request.) 
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4 3 



Select school as test sites: first two years, if close (2 hours) 

and showed an interest in the future — high black, high poor, 
high teacher turnover, high crime, diverse urban settings, 
district interest in team teaching and in high school student 
involvement . 

23 Meet with school representatives and draw up a proposal 

for the school. 

29 Meet with administrators to explain the proposal and answer 

questions re. the program. 

29 Interact with principal, cabinet, faculty on setting up a 

time schedule. 

29 Present the project to the faculty in a general staff meeting. 

Contact principal/staff about scheduling diagnostic data 
interviews . 

29 Contact principal/staff about scheduling time for questionnaires, 
interviews, and observations for historical data. 

05 Informally interview school faculty for preintervention data 

to identify problem areas. 

05 Informally observe faculty and students 1 classes for preinter- 

vention data to identify problem areas. 

05 Administer diagnostic questionnaires to faculty for pre- 

intervention data to identify organizational structure and 
related information . 

05 Process data (tally responses, characterize in writing the 

high points of interviews) for intervention planning team. 

05 Process interview results, by intervention team, to design 

the intervention. 

02 Discuss the design of the intervention around the group 

interaction theory of the project. 

22 Draw up a basic daily schedule for the intervention based 

on the problem areas, experience with other workshops, and a 
project sequence theory for training events. 

31 Meet with project staff to discuss the preliminary design 

for group intervention. 

22 Assign persons and responsiblities based on competence or 

desire for experience. 

22 Make a detailed plan for a block of time around the assigned 

problem using methodology of the project. 

04 Assemble any necessary materials for the intended plan. 

30 Distribute the plan to all members of the intervention team. 

31 Introduce the intervention training program schedule and 
the first section of events. 

29 Explain the first section of events in the intervention (training 

program) and give instructions to participating field test 
school faculty. 

31 Head up small groups when they are required by the plan. 

31 Keep a detailed diary by hand oi who was there, what they did, 

times, rate of talking, how grouped etc. for historical data 
which may later be used to evaluate why something happened. 

(time by wrist watch). 

31 Informally interview participants (field-test-site faculty) 

in halls, Johns, etc. for reactions an e problems. 



O 
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05 

06 
31 

05 

05 

05 

05 

29 

24 

33 

24 

31 

ENABLE RS : 

s uv 

3 27 
3 18 

3 22 

3 22 

2 02 

2 36 
2 25 
2 10 

2 39 
2 11 



Observe*, interview participants ( f leld-U*st-site faculty) 
for a later discussion of any necessary changes. 

Discuss with group intervention team (training team) any 
suggested changes in the intervention schedule. 

Meet with training team members first one or two evenings to 
discuss the training program format for any general changes 
in focus for the balance of the week-long training workshop 
which initiated the training program. 

Return to schools to collect evaluative data by interviews, 
observations, and questionnaires. 

Code the data from its respective forms. 

Make gross eyeball comparisons across sites and within sites 
on evaluative data collected. 

Evaluate data using correlations, analyses of variance, t-tests, 
analysis of co-variance, and various non-parametric techniques as 
chi-square . 

Consult with faculty/administration re. problems, progress, 
etc. 

Take corrective action where it is possible to do so with 
respect to the faculty working as a team within the scope 
of the projects objectives. 

Consult with project staff regarding problems which may 
necessitate further intervention sessions. 

Participate in faculty meetings to monitor, through observation, 
progress of the program on the faculty. 

Report findings in a memo to be distributed to project staff 
and filed for record. 



Sensitive to effectiveness of exercises used in an intervention. 
Senstitive to interpersonal tensions which participants 
bring into the program. 

Sensitive to feedback from participants regarding one'* 
relationship with the participants during the intervention. 
Sensitive to participant's perception of the intervention 
team through the degree of open criticism. 

Skill to "perf orming" in either large or small groups by 
being able to lecture, maintain rapport, be attractive 
and interesting without dominating or being abrasive. 

Skill in being an "hist orian," i.e., observing and cataloging 
a wealth of information by hand. 

Skill in being an "observer," estimating reliablity of data, 
selecting relevant data, etc. 

Skill in a variety of data analysis techniques including cor- 
relations, analysis of variances, analysis of co-variances, 
t-test, and non-parametric techniques as chi-square. 

Skill in preparing questionnaires. 

Skill in carrying out an interview objectively. 
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2 39 Skill in preparing observation forms. 

2 LO Skill in working with tables and numbers so as not to be 

afraid of either them or statistics. 

2 27 Skill in using the desk calculator for correlation, chi-square, 

etc . 

2 14 Skill in composition in order to write up a report or article 

for a designated audience. 

J. 04 Knowledge of a basic level of psychology and sociology in 

order to feel comfortable with the vocabulary and concepts, 
especially related to group development theory. 

1 03 Knowledge of what it is like to be in an unstructured group 

such as a sensitivity or a T-group , 

3 01 Sensitive to self-esteem as a factor in one's ability to 

write well . 

3 16 Sensitive to career point as a factor in one's ability to 

write well . 

3 36 Sensitive to confidence as a factor in one's ability to 

write well . 

3 11 Sensitive to the team feeling necessary to operate in 

the project. 

3 11 Sensitivie to crisis orientation, as opposed to being 

very structured, by having had experience in such as a 
long hike, mountain climbing, participated in civil rights 
marches, Peace Corps, social science interview in slums. 

3 01 Aware of how you react to other people to facilitate 
what you are trying to accomplish. 

3 34 Sensitive to not being too hung up or unfavorable about 

schools, i.e., thinking that they have "to change like 
crazy" to be any good. 



P-02: Interaction Observation Form; Evaluative 



"The main thing we wanted to test was, were people trying to under- 
stand other people. This is basically what our seeking category means. 
Also, we wanted to see how much interference there was such as somebody 
telling a joke, or a side conversation, or things of that sort. This 
is the meaning of our blocking and deflecting category. In addition 
we wanted a comparison between how much time was spent on task and 
how much time was spent on process. An extrememly rough instrument, 
but ve hoped it would give us the kind of thing we wanted which was 
some quantitative data." 
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o 



STAiJ J jAKUS : 



J_ _LM 
1 05 

1 16 
1 21 
1 22 

1 07 

TASKS : 
NO 
33 
22 
01 

02 
31 

04 
31 
31 

03 

03 

05 

06 

04 
06 

Ob 



Th'j observation form is capable of obtaining data for at 
liiast two or three of the types of data thit the "Unitized" Pro- 
ject was Interested in. 

There is ;* high correlation (visual) between this and the 
ques tiotfinaire and interview da;a. 

Observers report that the form and instructions are "extremely 
easy" to use. 

90% reliability (visual was actual method, since it was obvious) 
in data collection. 

Feel.'.ng that it worked right from having used the form. 



Decide there was a need for more quantifiable data to support 
interview and questionnaire data. 

Assign thiee people to work on observation system for a small 
group working together. 

Review literature in library for observation systems such 
as Bayles . 

Talk to colleagues about experience with various observation 
systems . 

Write memos to proje staff describing finding on observation 
systems . 

Select aspects of other systems which are desirable for ap- 
plication to Project "Unitized". 

Discus J writing a report on findings and recommendations re. 
ob ser v at ion sys tem . 

Write t:he report of findings and recommendat ions for an 
observation system from notes taken during discussion, memos, 
and library notes. 

Design an observation form which was "Relevant; and easy to 
use . " 

Specify criteria for use of the instrument for use in initial 
tests . 

Test the observation instrument on soap operas for ease of 
use and relevance of application. 

Subjectively evaluate results of informal test of the instrument 
for incended purposes. 

Specify a set of instructions based on the experience with the 
instrument. 

Test the instrument during actual "intervention" for ease of 
us • and applicability in obtaining desired information and using 
tw observers to check for reliability. 

Evaluate test of instrument and determine whether changes 
were necessary. 
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ENABLERS : 



S UV 

1 08 Knowledge of "group development" operations within the project. 

3 22 Sensitive to "flak" between members of small groups which 

occur in the group development "interventions." 

3 31 Sensitive to relevance of possible observation items to the 

"Unitized" subject and its requirements of simplicity and 
quantif iab iltiy of those items. 

1 08 Knowledge of what type of data was needed, e.g., communication. 

1 06 Knowedge of how to enter a school without setting faculty 

on alert, e.g., dress and attitude. 

3 04 Se*,sitive to how strong one is coming on as an enpert . (Too 

much is bad.) 



; P-03: Inhouse Memos: Test Schools Visits Reports 



"Theoretically we (training team leaders) write a memo every time 
we go to a school. That has been true for me except for one or two time ■> 
when I have just dropped by and haven* t done anything specific. This is 
mainly so that we can go back and see exactly what we did do, since we 
cannot do exactly the same things always." 



STANDARDS : 

1 LM 

1 13 A good comment from Project Directors (recognized as competent 

and skilled authors, one of whom used to be an English instructor) 
tather than a lot of red marks and questions. 

1 04 Good grammer, clear, precise, concise. 




TASKS : 

NO 

31 Take notes at site visitation for memo. 

31 Write a summary of what went on that is pertinent to the project 

including a feeling for ( a ) how smooth the process was going, 

(lb) how one was seen by the others, and (c) any insights which 
might be applicable to any other part of the project. 

06 Discuss the summary with team partner lor completeness and 

accuracy . 

04 Writ#* f he memo from the summary . 

22 Pile -i ropy of the memo by nrliool and ptop'M . 



A/J 



e4 



4 h 



EJiAHLhRS : 

S UV 

1 17 Knowledge of how to write clearly and concisely. 

1 07 Knowledge of the project and its goals in order to pick 

out pertinent items for action and memo. 

3 22 Sensitive to feeling of "where people are" in order to pick 
out pertinent items for action and memo. 



* 

004: Test Schools' Personnel (Trainees) Welfare 

i _ 



"Knowing pe >rle well enough to know when they are behaving some 
different way or something is wrong. I think another thing is 
having a lot of confidence in them." 



STANDARDS : 

J LM 

1 07 A fesling that things are going smoothly from discussions 
with faculty members. 



TASKS : 



NO 

05 

01 

02 

31 

24 

29 

29 



Observe faculty to be able to distinguish normal and abnormal 
behavior through frequent contact. 

Discuss problems with individuals exhibi. abnormal behavior 
to see if it may be overcome. 

Discuss problems with other faculty who have sensed or discussed 
the problem for their interpretation and reaction. 

Participate in informal gatherings to help develop team 
feeling, trust, and to isolate problems that would not 
otherwise surface. 

Do something about a problem whenever it is within the realm 
of the project and affects the team work. 

Verbalize confidence in individual c by building on strong 
points and expressing one's feeling that they are capable of 
doing difficult tasks. 

Decide how to work around problems that interfere with the 
team. 
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